tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.i81UKXU3IT', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 69.65 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: 04c0eeb0-5041-4825-a6cd-6046f386122e gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/z4y7dia3fp9xjsjz0vf7i7f657108n1q-nixos-system-gitlab-test/init regInfo=/nix/store/byrziazqj372yid00wklr26p8ffsgzz6-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/byrziazqj372yid00wklr26p8ffsgzz6-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000029] arm-pv: using stolen time PV gitlab # [ 0.000402] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000636] Console: colour dummy device 80x25 gitlab # [ 0.000643] printk: legacy console [tty0] enabled gitlab # [ 0.000826] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000832] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000918] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.001091] landlock: Up and running. gitlab # [ 0.001094] Yama: becoming mindful. gitlab # [ 0.001535] LSM support for eBPF active gitlab # [ 0.001719] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001822] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002918] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003580] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003584] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003731] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004747] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004843] EFI services will not be available. gitlab # [ 0.005008] smp: Bringing up secondary CPUs ... gitlab # [ 0.005655] Detected PIPT I-cache on CPU1 gitlab # [ 0.005752] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005874] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.005998] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007158] Detected PIPT I-cache on CPU2 gitlab # [ 0.007268] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007395] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.007518] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008600] Detected PIPT I-cache on CPU3 gitlab # [ 0.008714] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008837] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.008959] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009546] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009573] SMP: Total of 4 processors activated. gitlab # [ 0.009575] CPU: All CPU(s) started at EL1 gitlab # [ 0.009584] CPU features: detected: Branch Target Identification gitlab # [ 0.009588] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009590] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009594] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009597] CPU features: detected: Common not Private translations gitlab # [ 0.009600] CPU features: detected: CRC32 instructions gitlab # [ 0.009602] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009605] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009608] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009611] CPU features: detected: E0PD gitlab # [ 0.009613] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009616] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009619] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009621] CPU features: detected: Fine Grained Traps gitlab # [ 0.009624] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009628] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009630] CPU features: detected: LSE atomic instructions gitlab # [ 0.009633] CPU features: detected: Privileged Access Never gitlab # [ 0.009635] CPU features: detected: PMUv3 gitlab # [ 0.009638] CPU features: detected: RAS Extension Support gitlab # [ 0.009640] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009643] CPU features: detected: Random Number Generator gitlab # [ 0.009645] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009647] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009650] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009654] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009778] alternatives: applying system-wide alternatives gitlab # [ 0.012791] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012997] Memory: 5963752K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014444] devtmpfs: initialized gitlab # [ 0.018317] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018382] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018580] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018585] 0 pages in range for non-PLT usage gitlab # [ 0.018586] 508288 pages in range for PLT usage gitlab # [ 0.018704] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019523] DMI not present or invalid. gitlab # [ 0.023055] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.025399] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025685] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027420] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027443] audit: initializing netlink subsys (disabled) gitlab # [ 0.027800] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.028260] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.028263] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.028268] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.028270] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.028273] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028363] cpuidle: using governor ladder gitlab # [ 0.028424] cpuidle: using governor menu gitlab # [ 0.028667] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.028908] ASID allocator initialised with 65536 entries gitlab # [ 0.030011] Serial: AMBA PL011 UART driver gitlab # [ 0.035111] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.035433] printk: console [ttyAMA0] enabled gitlab # [ 0.045538] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.045558] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.045568] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.045576] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.045584] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.045592] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.045601] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.045609] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059276] fbcon: Taking over console gitlab # [ 0.059288] ACPI: Interpreter disabled. gitlab # [ 0.060250] iommu: Default domain type: Translated gitlab # [ 0.060255] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.069012] SCSI subsystem initialized gitlab # [ 0.069344] usbcore: registered new interface driver usbfs gitlab # [ 0.069368] usbcore: registered new interface driver hub gitlab # [ 0.069391] usbcore: registered new device driver usb gitlab # [ 0.069648] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.069652] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.069660] PTP clock support registered gitlab # [ 0.069696] EDAC MC: Ver: 3.0.0 gitlab # [ 0.070070] scmi_core: SCMI protocol bus registered gitlab # [ 0.070582] FPGA manager framework gitlab # [ 0.071395] vgaarb: loaded gitlab # [ 0.073237] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.073670] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.073693] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.074082] netfs: FS-Cache loaded gitlab # [ 0.074214] pnp: PnP ACPI: disabled gitlab # [ 0.080596] NET: Registered PF_INET protocol family gitlab # [ 0.081766] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.109333] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.109382] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.109428] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.109714] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.110262] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.110360] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.110412] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.110524] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.110699] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.110777] NET: Registered PF_XDP protocol family gitlab # [ 0.110793] PCI: CLS 0 bytes, default 64 gitlab # [ 0.111136] Trying to unpack rootfs image as initramfs... gitlab # [ 0.125380] kvm [1]: HYP mode not available gitlab # [ 0.214390] Initialise system trusted keyrings gitlab # [ 0.214711] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.215777] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.215852] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.233394] Key type asymmetric registered gitlab # [ 0.233400] Asymmetric key parser 'x509' registered gitlab # [ 0.233534] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.233871] io scheduler mq-deadline registered gitlab # [ 0.233879] io scheduler kyber registered gitlab # [ 0.245719] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.249475] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.250137] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.250162] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.250179] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.250191] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.250223] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.250259] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.250486] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.250499] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.250522] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.250530] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.250537] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.250701] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.251636] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.252025] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.252049] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.252103] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.252127] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.253138] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.253592] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.253617] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.253671] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.254648] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.255029] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.255054] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.255106] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.256062] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.256441] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.256464] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.256525] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.257556] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.257939] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.257963] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.258024] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.258993] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.259372] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.259395] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.259448] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.260452] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.260845] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.260869] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.260931] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.260955] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.262046] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.262467] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.262520] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.263530] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.263947] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.264000] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.264894] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.265336] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.265871] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.266343] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.266367] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.266419] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.267432] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.267826] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.267851] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.267904] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.269156] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.269170] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.269177] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.269294] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.269382] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.269471] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.269558] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.269650] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.269751] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.269839] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.269927] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.270015] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.270126] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.270212] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.270248] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.270283] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.270318] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.270356] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.270392] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.270428] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.270465] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.270502] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.270538] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.270576] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.270622] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.270658] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.270693] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.270729] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.270764] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.270801] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.270837] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.270881] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.270924] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.270969] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.271015] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.271026] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.271032] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.273733] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.293953] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.297137] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.300100] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.303317] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.309089] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.312286] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.315307] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.320020] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.324277] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.327076] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.330669] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.340306] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.342850] msm_serial: driver initialized gitlab # [ 0.343100] SuperH (H)SCI(F) driver initialized gitlab # [ 0.343177] STM32 USART driver initialized gitlab # [ 0.370565] loop: module loaded gitlab # [ 0.370820] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.373452] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.375829] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.378146] virtio_blk virtio5: [vdb] 12143576 512-byte logical blocks (6.22 GB/5.79 GiB) gitlab # [ 0.380719] megasas: 07.734.00.00-rc1 gitlab # [ 0.381758] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.384166] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.384214] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.386381] Using buffer write method gitlab # [ 0.386420] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.388722] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.388743] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.391137] Using buffer write method gitlab # [ 0.391157] Concatenating MTD devices: gitlab # [ 0.391160] (0): "0.flash" gitlab # [ 0.391163] (1): "0.flash" gitlab # [ 0.391166] into device "0.flash" gitlab # [ 0.562906] Freeing initrd memory: 27184K gitlab # [ 0.582001] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.590858] thunder_xcv, ver 1.0 gitlab # [ 0.590995] thunder_bgx, ver 1.0 gitlab # [ 0.591056] nicpf, ver 1.0 gitlab # [ 0.592921] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.592937] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.593005] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.593019] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.593118] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.593128] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.593191] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.593203] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.593734] sky2: driver version 1.30 gitlab # [ 0.598699] usbcore: registered new interface driver usb-storage gitlab # [ 0.599354] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.599392] usbserial: USB Serial support registered for generic gitlab # [ 0.599465] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.599524] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.600126] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.601366] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.603852] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.603908] rtc-pl031 9010000.pl031: setting system clock to 2026-08-11T09:55:12 UTC (1786442112) gitlab # [ 0.604817] i2c_dev: i2c /dev entries driver gitlab # [ 0.609455] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.610770] hub 1-0:1.0: USB hub found gitlab # [ 0.610870] hub 1-0:1.0: 6 ports detected gitlab # [ 0.613393] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.613408] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.614251] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.615391] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.620350] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.621199] usbcore: registered new interface driver usbhid gitlab # [ 0.621210] usbhid: USB HID core driver gitlab # [ 0.650921] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.655539] drop_monitor: Initializing network drop monitor service gitlab # [ 0.655843] NET: Registered PF_INET6 protocol family gitlab # [ 0.657660] Segment Routing with IPv6 gitlab # [ 0.657696] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.657797] NET: Registered PF_PACKET protocol family gitlab # [ 0.658105] 9pnet: Installing 9P2000 support gitlab # [ 0.662092] Key type dns_resolver registered gitlab # [ 0.680278] registered taskstats version 1 gitlab # [ 0.680788] Loading compiled-in X.509 certificates gitlab # [ 0.706288] Demotion targets for Node 0: null gitlab # [ 0.706518] Key type .fscrypt registered gitlab # [ 0.706526] Key type fscrypt-provisioning registered gitlab # [ 0.706799] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.706824] ima: Allocated hash algorithm: sha1 gitlab # [ 0.706860] ima: No architecture policies found gitlab # [ 0.708208] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.737523] clk: Disabling unused clocks gitlab # [ 0.737559] PM: genpd: Disabling unused power domains gitlab # [ 0.743454] Freeing unused kernel memory: 4736K gitlab # [ 0.743691] Run /init as init process gitlab # [ 0.775769] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.857316] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.013803] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.101897] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.110376] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.110450] systemd[1]: Detected virtualization qemu. gitlab # [ 1.110526] systemd[1]: Detected architecture arm64. gitlab # [ 1.110542] systemd[1]: Running in initrd. gitlab # [ 1.111428] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.111820] systemd[1]: Hostname set to . gitlab # [ 1.221331] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.359506] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.380514] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.380904] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.437872] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.456261] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.456526] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.456563] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.456577] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.456604] systemd[1]: Reached target Path Units. gitlab # [ 1.456622] systemd[1]: Reached target Slice Units. gitlab # [ 1.456641] systemd[1]: Reached target Swaps. gitlab # [ 1.456659] systemd[1]: Reached target Timer Units. gitlab # [ 1.456834] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.457007] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.457164] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.457432] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.457529] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.457552] systemd[1]: Reached target Socket Units. gitlab # [ 1.459403] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.461193] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.461298] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.463092] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.488602] systemd[1]: Starting Journal Service... gitlab # [ 1.492287] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.492545] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.496774] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.503665] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.505976] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.506717] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.515394] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.523351] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.523774] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.529112] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.529403] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.529407] [drm] features: -context_init gitlab # [ 1.530262] [drm] number of scanouts: 1 gitlab # [ 1.530276] [drm] number of cap sets: 0 gitlab # [ 1.530492] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.531288] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.531299] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.533889] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.537111] systemd-journald[95]: Collecting audit messages is disabled. gitlab # [ 1.540098] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.554890] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.561657] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.565096] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.569892] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.599068] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.599587] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.600479] systemd[1]: Reached target Local File Systems. gitlab # [ 1.608914] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.609047] systemd-modules-load[96]: Using 4 probe threads gitlab # [ 1.614559] systemd[1]: Started Journal Service. gitlab # [ 1.612217] systemd-modules-load[96]: Module 'virtio_balloon' is built in gitlab # [ 1.614490] systemd-modules-load[96]: Module 'virtio_console' is built in gitlab # [ 1.615711] systemd-modules-load[96]: Module 'virtio_rng' is built in gitlab # [ 1.616949] systemd-modules-load[96]: Inserted module 'dm_mod' gitlab # [ 1.617966] systemd-modules-load[96]: Inserted module 'virtio_gpu' gitlab # [ 1.622157] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.623913] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.643578] systemd-udevd[106]: Using default interface naming scheme 'v261'. gitlab # [ 1.653144] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.660327] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.684270] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.741259] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.745939] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.129188] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.131828] systemd[1]: Reached target System Initialization. gitlab # [ 2.134464] systemd[1]: Reached target Basic System. gitlab # [ 2.323721] (udev-worker)[122]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.328629] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.340291] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.378085] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.388538] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.390817] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.392261] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.427848] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.432265] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.495661] systemd[1]: Mounting /sysroot... gitlab # [ 2.531207] EXT4-fs (vda): mounted filesystem 04c0eeb0-5041-4825-a6cd-6046f386122e r/w with ordered data mode. Quota mode: none. gitlab # [ 2.530163] systemd[1]: Mounted /sysroot. gitlab # [ 2.532136] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.536465] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.540269] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.560188] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.564773] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.577340] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.586898] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.593328] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.598539] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.599353] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.602962] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.609950] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.619595] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.621628] systemd[1]: Reloading... gitlab # [ 2.651126] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.741046] systemd[1]: Reloading finished in 120 ms. gitlab # [ 2.792316] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.793820] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.794613] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.795346] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.796456] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.797736] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace... gitlab # [ 2.801004] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.802279] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.803246] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.804474] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.827104] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.828992] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.934853] (udev-worker)[120]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 2.938821] (udev-worker)[120]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 2.949712] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 2.950829] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 2.951584] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 2.952413] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.991022] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.993199] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.500388] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.576455] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.579578] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.582153] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.584455] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.627626] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.631263] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.644227] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.646379] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.649126] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.699206] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.701708] systemd[1]: Stopped target Basic System. gitlab # [ 3.703762] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.706138] systemd[1]: Stopped target Path Units. gitlab # [ 3.708153] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.711152] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.714361] systemd[1]: Stopped target Slice Units. gitlab # [ 3.717639] systemd[1]: Stopped target Socket Units. gitlab # [ 3.719804] systemd[1]: Stopped target System Initialization. gitlab # [ 3.722262] systemd[1]: Stopped target Swaps. gitlab # [ 3.725860] systemd[1]: Stopped target Timer Units. gitlab # [ 3.727907] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.732897] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.735320] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.738593] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.740771] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.743517] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.746274] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.748511] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.750236] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.752744] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.754591] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.757330] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.759834] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.762325] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.764406] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.766248] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.768663] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.771113] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.773019] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.775393] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.777676] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.779268] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.782305] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.784130] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.786086] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.787704] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.789846] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.791575] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.793475] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.795407] systemd[1]: systemd-udevd.service: Consumed 2.234s CPU time over 2.167s wall clock time, 31.9M memory peak. gitlab # [ 3.798295] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.800274] systemd[1]: Closed udev Control Socket. gitlab # [ 3.801662] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.803252] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.805623] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.807328] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.809480] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.811430] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.813204] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.879451] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.882352] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.883761] systemd[1]: Reached target Switch Root. gitlab # [ 3.885146] systemd[1]: Starting NixOS Activation... gitlab # [ 4.065300] initrd-nixos-activation-start[223]: booting system configuration /nix/store/z4y7dia3fp9xjsjz0vf7i7f657108n1q-nixos-system-gitlab-test gitlab # [ 4.125842] initrd-nixos-activation-start[223]: running activation script... gitlab # [ 4.437758] initrd-nixos-activation-start[246]: setting up /etc... gitlab # [ 4.614189] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.617631] systemd[1]: Finished NixOS Activation. gitlab # [ 4.619815] systemd[1]: Starting Switch Root... gitlab # [ 4.663658] systemd[1]: Switching root. gitlab # [ 4.765536] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.402034] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.402174] systemd[1]: Detected virtualization qemu. gitlab # [ 5.402247] systemd[1]: Detected architecture arm64. gitlab # [ 5.402417] systemd[1]: Detected first boot. gitlab # [ 5.403736] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.635146] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.764565] systemd[1]: Applying preset policy. gitlab # [ 6.031405] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.199639] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.200358] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.202380] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.209957] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.213841] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.218032] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.219417] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.220699] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.221774] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.222755] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.223757] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.224803] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.225902] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.226935] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.227967] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.229027] systemd[1]: Reached target Path Units. gitlab # [ 6.230113] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.231116] systemd[1]: Reached target Slice Units. gitlab # [ 6.232110] systemd[1]: Reached target Swaps. gitlab # [ 6.235976] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.240228] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.243284] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.246902] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.248246] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.257388] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.259551] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.263425] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.264957] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.266032] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.266975] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.272653] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.273966] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.275205] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.322047] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.327332] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.333582] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.341463] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.352502] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.365584] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.366620] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.381577] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.382524] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.383313] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.395389] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.399129] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.409590] systemd[1]: Starting Journal Service... gitlab # [ 6.413071] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.421226] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.435579] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.437411] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.446267] fuse: init (API version 7.45) gitlab # [ 6.447240] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.458404] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.461326] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.463554] systemd-journald[317]: Collecting audit messages is enabled. gitlab # [ 6.469777] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.472617] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.473368] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.476255] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.477210] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.478974] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.482325] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.481367] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.482168] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.484715] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.485884] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 6.485717] systemd[1]: Finished Load Kernel Modules. gitlab # gitlab # [ 6.491497] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.498193] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.493252] systemd-modules-load[318]: Using 3 probe threads gitlab # [ 6.496381] systemd-modules-load[318]: Module 'atkbd' is built in gitlab # [ 6.497679] systemd-modules-load[318]: Module 'loop' is built in gitlab # [ 6.499017] systemd-modules-load[318]: Inserted module 'tls' gitlab # [ 6.502917] systemd-oomd[319]: No swap; memory pressure usage will be degraded[ 6.509086] systemd[1]: Starting Firewall... gitlab # gitlab # [ 6.512294] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.517399] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.517469] EXT4-fs (vda): re-mounted 04c0eeb0-5041-4825-a6cd-6046f386122e. gitlab # [ 6.523382] systemd[1]: Started Journal Service. gitlab # [ 6.523002] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.526505] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.528202] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.537097] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.539173] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.541182] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.545609] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.546859] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.551421] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.553746] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.561188] systemd-journald[317]: Received client request to flush runtime journal. gitlab # [ 6.586009] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.587244] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.588244] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.589144] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.590096] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.591107] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.592435] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.651076] systemd-udevd[360]: Using default interface naming scheme 'v261'. gitlab # [ 6.691720] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.911404] systemd[1]: Finished Firewall. gitlab # [ 7.145108] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.201228] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.244588] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.248427] systemd[1]: Reached target Local File Systems. gitlab # [ 7.251064] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.254709] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.260836] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.265546] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.269135] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.274881] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.282637] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.371284] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.375021] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.378313] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.392676] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.398123] (udev-worker)[413]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.403690] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.408780] (udev-worker)[473]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.414471] (udev-worker)[473]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.416389] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.418311] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.447941] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.461255] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.463163] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.466537] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.470872] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.473857] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.475979] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.477450] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.480861] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.482197] systemd[1]: Starting Update is Completed... gitlab # [ 7.499039] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.510976] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.513733] systemd[1]: suid-sgid-wrappers.service: Consumed 152ms CPU time over 238ms wall clock time, 6.1M memory peak, 1.9M read from disk. gitlab # [ 7.518695] systemd[1]: Finished Update is Completed. gitlab # [ 7.529754] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.732182] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.734112] systemd[1]: Reached target System Initialization. gitlab # [ 7.735937] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.738112] systemd[1]: Started logrotate.timer. gitlab # [ 7.738865] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.739834] systemd[1]: Reached target Timer Units. gitlab # [ 7.742040] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.743005] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.759222] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.760342] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.761563] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.762433] systemd[1]: Reached target Socket Units. gitlab # [ 7.764491] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.798694] dbus-broker-launch[560]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.800074] dbus-broker-launch[560]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.801668] dbus-broker-launch[560]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.804795] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.815796] dbus-broker-launch[560]: Ready gitlab # [ 7.816903] systemd[1]: Reached target Basic System. gitlab # [ 7.818715] systemd[1]: Started backdoor.service. gitlab # [ 7.820879] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.822724] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.853729] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.861029] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.862384] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.868306] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.871665] logrotate[565]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # connecting to host... gitlab # [ 7.877462] logrotate[565]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # [ 7.878768] logrotate[565]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.879853] logrotate[565]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.882335] logrotate[565]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.883724] logrotate[565]: Allocating hash table for state file, size 64 entries gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.890393] logrotate[565]: Handling 4 logs gitlab # [ 7.891009] logrotate[565]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.893143] logrotate[565]: considering log /var/log/btmp gitlab # [ 7.893976] logrotate[565]: Creating new state gitlab: connected to guest root shell gitlab # [ 7.898346] logrotate[565]: Now: 2026-08-11 09:55 gitlab: (connecting took 8.36 seconds) gitlab # [ 7.899042] logrotate[565]: Last rotated at 2026-08-11 09:00 gitlab: (finished: waiting for the VM to finish booting, in 8.36 seconds) gitlab # [ 7.899790] logrotate[565]: log does not need rotating (log has already been rotated) gitlab # [ 7.903412] logrotate[565]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.907417] logrotate[565]: considering log /var/log/wtmp gitlab # [ 7.908150] logrotate[565]: Creating new state gitlab # [ 7.908708] logrotate[565]: Now: 2026-08-11 09:55 gitlab # [ 7.909374] logrotate[565]: Last rotated at 2026-08-11 09:00 gitlab # [ 7.915880] logrotate[565]: log does not need rotating (log has already been rotated) gitlab # [ 7.917660] logrotate[565]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.920502] logrotate[565]: switching euid from 0 to 165 and egid from 0 to 165 (pid 565) gitlab # [ 7.921744] logrotate[565]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.922688] logrotate[565]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.923776] logrotate[565]: Creating new state gitlab # [ 7.924457] logrotate[565]: switching euid from 165 to 0 and egid from 165 to 0 (pid 565) gitlab # [ 7.925520] logrotate[565]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.927764] logrotate[565]: switching euid from 0 to 60 and egid from 0 to 60 (pid 565) gitlab # [ 7.929538] logrotate[565]: considering log /var/log/nginx/*.log gitlab # [ 7.930380] logrotate[565]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.931384] logrotate[565]: Creating new state gitlab # [ 7.931981] logrotate[565]: not running postrotate script, since no logs were rotated gitlab # [ 7.933151] logrotate[565]: switching euid from 60 to 0 and egid from 60 to 0 (pid 565) gitlab # [ 7.935375] nsncd[566]: Aug 11 09:55:19.832 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.939449] systemd[1]: Starting resolvconf update... gitlab # [ 7.940631] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.941696] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.942596] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.943755] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.945730] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.947219] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.948167] systemd[1]: Starting User Login Management... gitlab # [ 8.070862] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 8.004243] systemd-logind[603]: New seat seat0. gitlab # [ 8.109499] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.110762] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.111906] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.113061] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.114016] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.114941] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.115826] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.116834] systemd[1]: nscd.service: Consumed 24ms CPU time over 212ms wall clock time, 7.1M memory peak, 5.8M read from disk. gitlab # [ 8.118349] systemd-logind[603]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.119599] systemd-logind[603]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.127131] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.129345] systemd[1]: Started User Login Management. gitlab # [ 8.146845] systemd[1]: Starting linger-users.service... gitlab # [ 8.150296] systemd[1]: Finished resolvconf update. gitlab # [ 8.155879] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.166737] systemd[1]: Starting DHCP Client... gitlab # [ 8.170615] nsncd[666]: Aug 11 09:55:20.069 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.175506] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.181270] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.184605] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.186593] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.195565] systemd[1]: Finished linger-users.service. gitlab # [ 8.199894] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.201727] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.227099] network-addresses-eth1-start[685]: adding address 192.168.1.1/24... done gitlab # [ 8.234507] network-addresses-eth1-start[685]: adding address 2001:db8:1::1/64... done gitlab # [ 8.239568] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.264474] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.302334] systemd-logind[603]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.315871] dhcpcd[700]: dhcpcd-10.3.2 starting gitlab # [ 8.317027] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.318500] dhcpcd[756]: dev: loaded udev gitlab # [ 8.319627] systemd[1]: Reached target Network. gitlab # [ 8.328061] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.334692] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.335052] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.331194] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.337806] systemd-vconsole-setup[719]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.339541] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.343309] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.348166] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.350915] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.358756] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.372849] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.385031] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.389818] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.390333] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.391935] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.381179] systemd[1]: Started Getty on tty1.[ 8.392257] cfg80211: failed to load regulatory.db gitlab # gitlab # [ 8.393257] systemd[1]: Reached target Login Prompts. gitlab # [ 8.432824] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.429984] dhcpcd[756]: eth0: waiting for carrier gitlab # [ 8.430881] dhcpcd[756]: eth0: carrier acquired gitlab # [ 8.437254] dhcpcd[756]: DUID 00:01:00:01:32:0d:ae:08:52:54:00:12:34:56 gitlab # [ 8.438497] dhcpcd[756]: eth0: IAID 00:12:34:56 gitlab # [ 8.439195] dhcpcd[756]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.481127] nginx-pre-start[788]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.482924] nginx-pre-start[788]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.486304] systemd[1]: Started Nginx Web Server. gitlab # [ 8.532640] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.535005] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.537702] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started gitlab # [ 8.539264] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.540108] redis-server[792]: Configuration loaded gitlab # [ 8.540995] redis[792]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.542169] redis[792]: Running mode=standalone, port=0. gitlab # [ 8.543523] redis[792]: Server initialized gitlab # [ 8.544611] redis[792]: Ready to accept connections unix gitlab # [ 8.545629] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.557128] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.559226] postgresql-pre-start[795]: This user must also own the server process. gitlab # [ 8.560687] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.562149] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.563388] postgresql-pre-start[795]: The default text search configuration will be set to "english". gitlab # [ 8.564651] postgresql-pre-start[795]: Data page checksums are enabled. gitlab # [ 8.565618] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.567076] postgresql-pre-start[795]: creating subdirectories ... ok gitlab # [ 8.567952] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.603616] postgresql-pre-start[795]: selecting default "max_connections" ... 100 gitlab # [ 8.651219] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.904975] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.085742] postgresql-pre-start[795]: selecting default time zone ... UTC gitlab # [ 9.087748] postgresql-pre-start[795]: creating configuration files ... ok gitlab # [ 9.217961] gitlab-workhorse[818]: time="2026-08-11T09:55:21Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.223238] gitlab-workhorse[818]: time="2026-08-11T09:55:21Z" level=info msg="Using redis/go-redis" gitlab # [ 9.232508] gitlab-workhorse[818]: time="2026-08-11T09:55:21Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.328528] postgresql-pre-start[795]: running bootstrap script ... ok gitlab # [ 9.808118] dhcpcd[756]: eth0: soliciting a DHCP lease gitlab # [ 9.825163] dhcpcd[756]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.844551] dhcpcd[756]: eth0: probing address 10.0.2.15/24 gitlab # [ 9.948602] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok gitlab # [ 10.022971] dhcpcd[756]: eth0: soliciting an IPv6 router gitlab # [ 10.024321] dhcpcd[756]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.025526] dhcpcd[756]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.026932] dhcpcd[756]: eth0: adding route to fec0::/64 gitlab # [ 10.028138] dhcpcd[756]: eth0: adding default route via fe80::2 gitlab # [ 10.169846] postgresql-pre-start[795]: syncing data to disk ... ok gitlab # [ 10.172709] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.176791] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.183136] postgresql-pre-start[795]: Success. You can now start the database server using: gitlab # [ 10.186755] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.369854] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.375579] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.378980] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.382737] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.392955] postgres[861]: [861] LOG: database system was shut down at 2026-08-11 09:55:21 GMT gitlab # [ 10.407712] postgres[852]: [852] LOG: database system is ready to accept connections gitlab # [ 10.413044] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.421664] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.813013] postgresql-setup-start[872]: CREATE DATABASE gitlab # [ 10.861315] postgresql-setup-start[882]: CREATE ROLE gitlab # [ 10.884325] postgresql-setup-start[884]: ALTER DATABASE gitlab # [ 10.889857] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[877]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 10.893956] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[877]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 10.917268] postgresql-setup-start[893]: CREATE ROLE gitlab # [ 10.921364] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 10.923826] systemd[1]: Reached target PostgreSQL. gitlab # [ 10.928833] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 10.978218] systemd[1]: Finished gitlab-config.service. gitlab # [ 10.985182] systemd[1]: Started gitaly.service. gitlab # [ 10.990564] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.118482] gitlab-postgresql-start[911]: CREATE DATABASE gitlab # [ 11.189575] gitlab-postgresql-start[922]: CREATE EXTENSION gitlab # [ 11.324474] gitlab-postgresql-start[933]: CREATE EXTENSION gitlab # [ 11.327582] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 11.613134] gitaly[909]: time="2026-08-11T09:55:23.510Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=909 gitlab # [ 11.628666] gitaly[909]: time="2026-08-11T09:55:23.511Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=909 gitlab # [ 11.635274] gitaly[909]: time="2026-08-11T09:55:23.511Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=909 gitlab # [ 11.642507] gitaly[909]: time="2026-08-11T09:55:23.511Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=909 gitlab # [ 11.652415] gitaly[909]: time="2026-08-11T09:55:23.511Z" level=info msg="Starting Gitaly" pid=909 version= gitlab # [ 11.821595] gitaly[909]: time="2026-08-11T09:55:23.722Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=210 pid=909 gitlab # [ 11.823416] gitaly[909]: time="2026-08-11T09:55:23.722Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=909 gitlab # [ 11.825418] gitaly[909]: time="2026-08-11T09:55:23.723Z" level=info msg="finished initializing command factory" duration_ms=0 pid=909 gitlab # [ 11.827538] gitaly[909]: time="2026-08-11T09:55:23.723Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-909/git-exec-2179107057.d/git pid=909 gitlab # [ 11.832475] gitaly[909]: time="2026-08-11T09:55:23.733Z" level=info msg="finished detecting git version" duration_ms=10 pid=909 gitlab # [ 11.834184] gitaly[909]: time="2026-08-11T09:55:23.733Z" level=info msg="using Git version" pid=909 version=2.53.g gitlab # [ 11.835842] gitaly[909]: time="2026-08-11T09:55:23.733Z" level=info msg="clearing disk cache object folder" pid=909 storage=default gitlab # [ 11.838016] gitaly[909]: time="2026-08-11T09:55:23.734Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3439242381 pid=909 storage=default gitlab # [ 11.840883] gitaly[909]: time="2026-08-11T09:55:23.734Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3439242381 pid=909 storage=default gitlab # [ 11.844192] gitaly[909]: time="2026-08-11T09:55:23.734Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=909 gitlab # [ 11.846904] gitaly[909]: time="2026-08-11T09:55:23.734Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=909 gitlab # [ 11.849915] gitaly[909]: time="2026-08-11T09:55:23.734Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3439242381 clear_duration_ms=0 pid=909 storage=default gitlab # [ 11.853691] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="counting repositories" pid=909 gitlab # [ 11.855276] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="starting to count repositories" pid=909 storage_path=/var/gitlab/state/repositories gitlab # [ 11.857472] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="finished tempdir cleaner walk" pid=909 storage=default time_ms=0 gitlab # [ 11.859273] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=909 gitlab # [ 11.862327] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=909 storage_path=/var/gitlab/state/repositories gitlab # [ 11.865117] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="completed counting all repositories" counting_duration=0 pid=909 gitlab # [ 11.866913] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=909 schema=unix gitlab # [ 11.869451] gitaly[909]: time="2026-08-11T09:55:23.754Z" level=info msg="listening at address" address=/run/gitaly/gitaly-909/sock.d/intern pid=909 schema=unix gitlab # [ 11.871816] gitaly[909]: time="2026-08-11T09:55:23.755Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=909 gitlab # [ 11.873835] gitaly[909]: time="2026-08-11T09:55:23.755Z" level=info msg="Started Gitaly" duration_ms=244 pid=909 gitlab # [ 11.875251] gitaly[909]: time="2026-08-11T09:55:23.756Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=909 gitlab # [ 11.877137] gitaly[909]: time="2026-08-11T09:55:23.756Z" level=info msg="maintenance: daily scheduled" pid=909 scheduled="2026-08-11 12:00:00 +0000 UTC" gitlab # [ 12.350284] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[914]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.358629] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[914]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.400149] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[914]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 15.509699] dhcpcd[756]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 15.510173] dhcpcd[756]: eth0: adding route to 10.0.2.0/24 gitlab # [ 15.510322] dhcpcd[756]: eth0: adding default route via 10.0.2.2 gitlab # [ 15.719515] systemd[1]: Started DHCP Client. gitlab # [ 15.723433] systemd[1]: Reached target Network is Online. gitlab # [ 15.903691] gitaly[909]: time="2026-08-11T09:55:27.803Z" level=info msg="License database preloaded" duration_ms=4291 pid=909 gitlab # [ 58.610175] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[914]: W, [2026-08-11T09:56:10.510122 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.306005] gitlab-workhorse[818]: time="2026-08-11T09:56:11Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 61.629916] postgres[1447]: [1447] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 61.630295] postgres[1447]: [1447] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 61.630421] postgres[1447]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 61.630536] postgres[1447]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 61.630675] postgres[1447]: attidentity AS identity, gitlab # [ 61.630821] postgres[1447]: attgenerated as attgenerated gitlab # [ 61.630940] postgres[1447]: FROM pg_attribute a gitlab # [ 61.631067] postgres[1447]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 61.631193] postgres[1447]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 61.631308] postgres[1447]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 61.631422] postgres[1447]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 61.631536] postgres[1447]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 61.631658] postgres[1447]: ORDER BY a.attnum gitlab # [ 61.631771] postgres[1447]: gitlab # [ 66.770091] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1498]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 66.770478] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1498]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.313683] gitlab-workhorse[818]: time="2026-08-11T09:56:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.322208] gitlab-workhorse[818]: time="2026-08-11T09:56:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.333662] gitlab-workhorse[818]: time="2026-08-11T09:56:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 93.864124] postgres[1596]: [1596] ERROR: relation "table_without_models" does not exist gitlab # [ 93.864488] postgres[1596]: [1596] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.335059] gitlab-workhorse[818]: time="2026-08-11T09:56:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.342345] gitlab-workhorse[818]: time="2026-08-11T09:57:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.343620] gitlab-workhorse[818]: time="2026-08-11T09:57:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 123.542844] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 123.548768] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 123.554530] systemd[1]: Starting gitlab.service... gitlab # [ 124.137447] bundle[1976]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 124.143787] bundle[1976]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 124.149881] bundle[1976]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 128.972128] sidekiq-cluster[1975]: {"severity":"INFO","time":"2026-08-11T09:57:20.843Z","message":"Starting cluster with 1 processes"} gitlab # [ 129.071445] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.941Z","pid":1976,"message":"* Enabling systemd notification integration"} gitlab # [ 129.076581] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"Puma starting in cluster mode..."} gitlab # [ 129.080961] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 129.085668] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 129.092130] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Min threads: 0"} gitlab # [ 129.095993] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Max threads: 4"} gitlab # [ 129.100407] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Environment: production"} gitlab # [ 129.104724] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Master PID: 1976"} gitlab # [ 129.109111] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Workers: 2"} gitlab # [ 129.113577] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 129.119091] bundle[1976]: {"timestamp":"2026-08-11T09:57:20.971Z","pid":1976,"message":"* Preloading application"} gitlab # [ 129.347325] gitlab-workhorse[818]: time="2026-08-11T09:57:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.358957] gitlab-workhorse[818]: time="2026-08-11T09:57:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.360122] gitlab-workhorse[818]: time="2026-08-11T09:57:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.366244] gitlab-workhorse[818]: time="2026-08-11T09:57:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 168.526452] bundle[1976]: W, [2026-08-11T09:58:00.426486 #1976] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.367268] gitlab-workhorse[818]: time="2026-08-11T09:58:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 171.731768] sidekiq-cluster[2024]: 2026-08-11T09:58:03.631Z pid=2024 tid=wn4 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2024, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432283648} gitlab # [ 172.014322] sidekiq-cluster[2024]: W, [2026-08-11T09:58:03.915310 #2024] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 172.079354] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:03.980Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 175.722586] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.622Z","message":"GitLab reliable fetch activated!"} gitlab # [ 175.722992] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.622Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 175.755847] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.656Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 175.763030] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.659Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 175.770186] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.662Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 175.776769] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.665Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 175.784182] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.668Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 175.790749] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.671Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 175.796797] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.673Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 175.801616] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.676Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 175.806191] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.678Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 175.810398] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.680Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 175.814797] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.682Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 175.818819] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.684Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 175.822385] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.686Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 175.826024] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.689Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 175.829401] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.691Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 175.832606] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.693Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 175.835492] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.696Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 175.838418] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.699Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 175.841441] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.702Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 175.844172] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.705Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 175.847102] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.707Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 175.850200] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.710Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 175.852763] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.713Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 175.855304] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.715Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 175.857965] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.718Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 175.860240] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.721Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 175.862398] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.724Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 175.864625] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.726Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 175.866836] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.729Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 175.869293] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.732Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 175.871423] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.734Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 175.873916] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.737Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 175.875988] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.740Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 175.878364] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.742Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 175.880475] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.745Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 175.882704] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.747Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 175.884868] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.749Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 175.886838] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.751Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 175.888921] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.754Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 175.890895] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.755Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 175.893106] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.757Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 175.895179] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.759Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 175.897403] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.761Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 175.899415] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.763Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 175.901681] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.766Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 175.903895] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.768Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 175.906157] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.770Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 175.908295] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.772Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 175.910300] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.774Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 175.912361] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.777Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 175.914377] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.780Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 175.916400] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.782Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 175.918425] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.796Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 175.920795] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.799Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 175.922934] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.801Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 175.925133] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.804Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 175.927267] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.806Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 175.929621] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.808Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 175.931776] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.810Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 175.935152] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.812Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 175.937233] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.814Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 175.939204] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.815Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 175.941499] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.818Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 175.943612] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.821Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 175.945942] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.823Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 175.948064] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.826Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 175.950081] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.828Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 175.952211] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.829Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 175.954447] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.831Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 175.956731] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.833Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 175.958879] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.835Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 175.961059] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.837Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 175.963160] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.839Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 175.965499] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.840Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 175.967684] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.842Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 175.970121] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.844Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 175.972294] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.846Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 175.974686] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.850Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 175.976891] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.852Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 175.979025] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.854Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 175.981602] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.857Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 175.984173] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.859Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 175.986411] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.862Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 175.988621] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.864Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 175.990897] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.866Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 175.993444] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.867Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 175.995769] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.870Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 175.998492] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.872Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 176.000795] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.873Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 176.002949] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.875Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 176.005270] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.877Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 176.007616] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.879Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 176.010027] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.880Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 176.012451] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.882Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 176.014406] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.885Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 176.016749] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.887Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 176.018975] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.889Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 176.021307] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.891Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 176.032226] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.933Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 176.034430] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.935Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 176.037403] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.938Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 176.043974] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.945Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 176.050236] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.951Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 176.056953] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:07.956Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 176.103053] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:08.002Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 176.110750] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:08.006Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 176.117438] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:08.008Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 176.124469] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:08.011Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 176.131226] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:08.015Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 179.368698] gitlab-workhorse[818]: time="2026-08-11T09:58:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.370110] gitlab-workhorse[818]: time="2026-08-11T09:58:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.381704] gitlab-workhorse[818]: time="2026-08-11T09:58:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 209.390221] gitlab-workhorse[818]: time="2026-08-11T09:58:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 215.969698] postgres[2763]: [2763] ERROR: relation "table_without_models" does not exist gitlab # [ 215.973321] postgres[2763]: [2763] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 219.399672] gitlab-workhorse[818]: time="2026-08-11T09:58:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 219.673697] postgres[2783]: [2783] ERROR: relation "table_without_models" does not exist gitlab # [ 219.676245] postgres[2783]: [2783] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 222.049959] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:53.949Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 222.056196] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:53.950Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 222.058161] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:53.950Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 222.060044] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:53.950Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 222.062014] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:53.954Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 224.774185] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:56.674Z","message":"Cleaning working queues"} gitlab # [ 224.784367] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:56.684Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0ff85e0a5eb83626b126a195","created_at":"2026-08-11T09:57:14.868Z","trace_propagation_headers":{"sentry-trace":"e4a5c66b31cf4abebb808bb5e9de3573-705f20eff60d401f","baggage":"sentry-trace_id=e4a5c66b31cf4abebb808bb5e9de3573,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2abf1e9edfbd62ce8bbb1611fa540774","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T09:57:14.882Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0ff85e0a5eb83626b126a195: start","job_status":"start","queue_duration_s":101.80177,"scheduling_latency_s":101.801878} gitlab # [ 225.181745] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:58:57.082Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0ff85e0a5eb83626b126a195","created_at":"2026-08-11T09:57:14.868Z","trace_propagation_headers":{"sentry-trace":"e4a5c66b31cf4abebb808bb5e9de3573-705f20eff60d401f","baggage":"sentry-trace_id=e4a5c66b31cf4abebb808bb5e9de3573,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2abf1e9edfbd62ce8bbb1611fa540774","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T09:57:14.882Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0ff85e0a5eb83626b126a195: done: 0.397741 sec","job_status":"done","queue_duration_s":101.80177,"scheduling_latency_s":101.801878,"redis_calls":29,"redis_duration_s":0.013495,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007814,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003782,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19244354,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.397741,"completed_at":"2026-08-11T09:58:57.081Z","load_balancing_strategy":"primary","db_duration_s":0.088146,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 226.831869] bundle[1976]: {"timestamp":"2026-08-11T09:58:58.731Z","pid":1976,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 226.832233] bundle[1976]: {"timestamp":"2026-08-11T09:58:58.732Z","pid":1976,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 226.832420] bundle[1976]: {"timestamp":"2026-08-11T09:58:58.732Z","pid":1976,"message":"! #\u003cThread:0x0000f44871e03068 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 226.832533] bundle[1976]: {"timestamp":"2026-08-11T09:58:58.732Z","pid":1976,"message":"! #\u003cThread:0x0000f44872004da8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 226.832649] bundle[1976]: {"timestamp":"2026-08-11T09:58:58.732Z","pid":1976,"message":"Use Ctrl-C to stop"} gitlab # [ 226.832762] bundle[1976]: {"timestamp":"2026-08-11T09:58:58.732Z","pid":1976,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 230.012961] bundle[1976]: {"timestamp":"2026-08-11T09:59:01.913Z","pid":1976,"message":"- Worker 0 (PID: 2909) booted in 3.14s, phase: 0"} gitlab # [ 230.017973] bundle[1976]: {"timestamp":"2026-08-11T09:59:01.919Z","pid":1976,"message":"- Worker 1 (PID: 2913) booted in 3.13s, phase: 0"} gitlab # [ 230.023769] systemd[1]: Started gitlab.service. gitlab # [ 230.026153] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 230.031789] systemd[1]: Starting setup-gitlab.service... gitlab # [ 230.082800] setup-gitlab-start[2967]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 230.970993] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:09:59:02 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 843 gitlab # [ 230.975489] setup-gitlab-start[2967]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 230.979888] setup-gitlab-start[2967]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 230.996555] runuser[2983]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 231.560503] setup-gitlab-start[2984]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 231.567012] setup-gitlab-start[2984]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 231.573392] setup-gitlab-start[2984]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.374850] setup-gitlab-start[2984]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.375205] setup-gitlab-start[2984]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.377447] setup-gitlab-start[2984]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 239.381965] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0b772409da8d246ced05ac9c","created_at":"2026-08-11T09:59:11.139Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a21931b2349feea9ef99575981fe6c7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.277Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0b772409da8d246ced05ac9c: start","job_status":"start","queue_duration_s":0.0037,"scheduling_latency_s":0.00376} gitlab # [ 239.575985] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.476Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 239.670743] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0b772409da8d246ced05ac9c","created_at":"2026-08-11T09:59:11.139Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a21931b2349feea9ef99575981fe6c7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.277Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0b772409da8d246ced05ac9c: done: 0.289151 sec","job_status":"done","queue_duration_s":0.0037,"scheduling_latency_s":0.00376,"redis_calls":10,"redis_duration_s":0.033284,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003678,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.02599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00401972,"duration_s":0.289151,"completed_at":"2026-08-11T09:59:11.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.764269] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8f41dc1c3f4fc08d2bf7f0ab","created_at":"2026-08-11T09:59:11.303Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e666116e72489c02037fec84e82e38c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.317Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8f41dc1c3f4fc08d2bf7f0ab: start","job_status":"start","queue_duration_s":0.304912,"scheduling_latency_s":0.304958} gitlab # [ 239.854851] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.755Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 239.906408] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8f41dc1c3f4fc08d2bf7f0ab","created_at":"2026-08-11T09:59:11.303Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e666116e72489c02037fec84e82e38c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.317Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8f41dc1c3f4fc08d2bf7f0ab: done: 0.184022 sec","job_status":"done","queue_duration_s":0.304912,"scheduling_latency_s":0.304958,"redis_calls":10,"redis_duration_s":0.018882,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003837,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002145,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00358722,"duration_s":0.184022,"completed_at":"2026-08-11T09:59:11.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.982953] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0ee0f922894219e969e7932a","created_at":"2026-08-11T09:59:11.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df9252bf77ecbef8cfcdb7c2e682a09b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.359Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0ee0f922894219e969e7932a: start","job_status":"start","queue_duration_s":0.461934,"scheduling_latency_s":0.461981} gitlab # [ 240.074360] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:11.974Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0ee0f922894219e969e7932a","created_at":"2026-08-11T09:59:11.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df9252bf77ecbef8cfcdb7c2e682a09b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.359Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0ee0f922894219e969e7932a: done: 0.152178 sec","job_status":"done","queue_duration_s":0.461934,"scheduling_latency_s":0.461981,"redis_calls":12,"redis_duration_s":0.01417,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0012,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005327,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00209888,"exclusive_lock_hold_duration_s":0.08232732,"duration_s":0.152178,"completed_at":"2026-08-11T09:59:11.973Z","load_balancing_strategy":"primary","db_duration_s":0.070168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.159972] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"267da9ed5d64d743ae9cd64e","created_at":"2026-08-11T09:59:11.369Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.399Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-267da9ed5d64d743ae9cd64e: start","job_status":"start","queue_duration_s":0.606619,"scheduling_latency_s":0.606664} gitlab # [ 240.249960] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"267da9ed5d64d743ae9cd64e","created_at":"2026-08-11T09:59:11.369Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.399Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-267da9ed5d64d743ae9cd64e: done: 0.144236 sec","job_status":"done","queue_duration_s":0.606619,"scheduling_latency_s":0.606664,"redis_calls":19,"redis_duration_s":0.008062999999999999,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002316,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000704,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003678,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051488,"duration_s":0.144236,"completed_at":"2026-08-11T09:59:12.150Z","load_balancing_strategy":"primary","db_duration_s":0.004765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.340125] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"83fe7c01ccb0189d09e3bf85","created_at":"2026-08-11T09:59:11.428Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d14035b456d5e800be760cd16497cd1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.441Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-83fe7c01ccb0189d09e3bf85: start","job_status":"start","queue_duration_s":0.711219,"scheduling_latency_s":0.711253} gitlab # [ 240.357130] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.235Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"83fe7c01ccb0189d09e3bf85","created_at":"2026-08-11T09:59:11.428Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d14035b456d5e800be760cd16497cd1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.441Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-83fe7c01ccb0189d09e3bf85: done: 0.082715 sec","job_status":"done","queue_duration_s":0.711219,"scheduling_latency_s":0.711253,"redis_calls":16,"redis_duration_s":0.005616,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00299,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007714,"duration_s":0.082715,"completed_at":"2026-08-11T09:59:12.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.400417] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1a64ce38f30bcd14f7077ae5","created_at":"2026-08-11T09:59:11.459Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e54e03b1041bde83e0c72e487f8026b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.485Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1a64ce38f30bcd14f7077ae5: start","job_status":"start","queue_duration_s":0.752733,"scheduling_latency_s":0.752761} gitlab # [ 240.414785] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1a64ce38f30bcd14f7077ae5","created_at":"2026-08-11T09:59:11.459Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e54e03b1041bde83e0c72e487f8026b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.485Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1a64ce38f30bcd14f7077ae5: done: 0.046503 sec","job_status":"done","queue_duration_s":0.752733,"scheduling_latency_s":0.752761,"redis_calls":13,"redis_duration_s":0.003874,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001995,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01383674,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.046503,"completed_at":"2026-08-11T09:59:12.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004813,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.460018] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"874348bcbe486e0b1239b7d6","created_at":"2026-08-11T09:59:11.492Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4476b5215c4e1e5af8f74e7b217936ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.520Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-874348bcbe486e0b1239b7d6: start","job_status":"start","queue_duration_s":0.765532,"scheduling_latency_s":0.765553} gitlab # [ 240.474575] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.302Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 240.478018] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"874348bcbe486e0b1239b7d6","created_at":"2026-08-11T09:59:11.492Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4476b5215c4e1e5af8f74e7b217936ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.520Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-874348bcbe486e0b1239b7d6: done: 0.025136 sec","job_status":"done","queue_duration_s":0.765532,"scheduling_latency_s":0.765553,"redis_calls":10,"redis_duration_s":0.002709,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000551,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041148,"duration_s":0.025136,"completed_at":"2026-08-11T09:59:12.311Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.520243] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5e97867d97f7a40237c432e1","created_at":"2026-08-11T09:59:11.561Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8667918b1ad5ae4394fec9b3421906ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.577Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5e97867d97f7a40237c432e1: start","job_status":"start","queue_duration_s":0.735517,"scheduling_latency_s":0.735535} gitlab # [ 240.730929] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5e97867d97f7a40237c432e1","created_at":"2026-08-11T09:59:11.561Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8667918b1ad5ae4394fec9b3421906ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.577Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5e97867d97f7a40237c432e1: done: 0.317598 sec","job_status":"done","queue_duration_s":0.735517,"scheduling_latency_s":0.735535,"redis_calls":14,"redis_duration_s":0.004201,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001023,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.043,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.244857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057914,"exclusive_lock_hold_duration_s":0.28141214,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.317598,"completed_at":"2026-08-11T09:59:12.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.829119] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e19f84c90c8cb1d7de191a0","created_at":"2026-08-11T09:59:11.617Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.626Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e19f84c90c8cb1d7de191a0: start","job_status":"start","queue_duration_s":1.007984,"scheduling_latency_s":1.008011} gitlab # [ 240.863626] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.764Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e19f84c90c8cb1d7de191a0","created_at":"2026-08-11T09:59:11.617Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.626Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e19f84c90c8cb1d7de191a0: done: 0.130085 sec","job_status":"done","queue_duration_s":1.007984,"scheduling_latency_s":1.008011,"redis_calls":71,"redis_duration_s":0.018609,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002857,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001319,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013602,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032408,"duration_s":0.130085,"completed_at":"2026-08-11T09:59:12.764Z","load_balancing_strategy":"primary","db_duration_s":0.003131,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.947011] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"684bab703dd0b79e736b1fff","created_at":"2026-08-11T09:59:11.635Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3209b800bc8f9debab80cb3db96d164","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.644Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-684bab703dd0b79e736b1fff: start","job_status":"start","queue_duration_s":1.121803,"scheduling_latency_s":1.121826} gitlab # [ 240.963585] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"684bab703dd0b79e736b1fff","created_at":"2026-08-11T09:59:11.635Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3209b800bc8f9debab80cb3db96d164","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.644Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-684bab703dd0b79e736b1fff: done: 0.028562 sec","job_status":"done","queue_duration_s":1.121803,"scheduling_latency_s":1.121826,"redis_calls":10,"redis_duration_s":0.003055,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000968,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037364,"duration_s":0.028562,"completed_at":"2026-08-11T09:59:12.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.008618] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"67b3da097ea667dc5aafbbdf","created_at":"2026-08-11T09:59:11.659Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe9a4309a930190ae712e880f10d3a9a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.667Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-67b3da097ea667dc5aafbbdf: start","job_status":"start","queue_duration_s":1.12852,"scheduling_latency_s":1.128537} gitlab # [ 241.023462] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.808Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 241.027324] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"67b3da097ea667dc5aafbbdf","created_at":"2026-08-11T09:59:11.659Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe9a4309a930190ae712e880f10d3a9a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.667Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-67b3da097ea667dc5aafbbdf: done: 0.019696 sec","job_status":"done","queue_duration_s":1.12852,"scheduling_latency_s":1.128537,"redis_calls":10,"redis_duration_s":0.002696,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034616,"duration_s":0.019696,"completed_at":"2026-08-11T09:59:12.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.070102] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f85e3cdcf17b6437d70a6709","created_at":"2026-08-11T09:59:11.676Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e9b303a52367fac6eed904a464ec5e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.682Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f85e3cdcf17b6437d70a6709: start","job_status":"start","queue_duration_s":1.134991,"scheduling_latency_s":1.135008} gitlab # [ 241.085866] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f85e3cdcf17b6437d70a6709","created_at":"2026-08-11T09:59:11.676Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e9b303a52367fac6eed904a464ec5e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.682Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f85e3cdcf17b6437d70a6709: done: 0.029094 sec","job_status":"done","queue_duration_s":1.134991,"scheduling_latency_s":1.135008,"redis_calls":12,"redis_duration_s":0.001861,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026598,"duration_s":0.029094,"completed_at":"2026-08-11T09:59:12.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.128250] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f2c1679e4594ad349a171007","created_at":"2026-08-11T09:59:11.688Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"085e9b9010c5ce749844b8aadd4f9eed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T09:59:11.694Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f2c1679e4594ad349a171007: start","job_status":"start","queue_duration_s":1.152698,"scheduling_latency_s":1.152715} gitlab # [ 241.141437] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.859Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 241.144716] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f2c1679e4594ad349a171007","created_at":"2026-08-11T09:59:11.688Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"085e9b9010c5ce749844b8aadd4f9eed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T09:59:11.694Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f2c1679e4594ad349a171007: done: 0.019424 sec","job_status":"done","queue_duration_s":1.152698,"scheduling_latency_s":1.152715,"redis_calls":10,"redis_duration_s":0.001358,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002278,"duration_s":0.019424,"completed_at":"2026-08-11T09:59:12.866Z","load_balancing_strategy":"primary","db_duration_s":0.000698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.186114] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8e69534bed271207a241124c","created_at":"2026-08-11T09:59:11.715Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0eb85a70507746b15b47e55cd4e8c55f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.747Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8e69534bed271207a241124c: start","job_status":"start","queue_duration_s":1.121149,"scheduling_latency_s":1.121168} gitlab # [ 241.200174] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8e69534bed271207a241124c","created_at":"2026-08-11T09:59:11.715Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0eb85a70507746b15b47e55cd4e8c55f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.747Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8e69534bed271207a241124c: done: 0.048224 sec","job_status":"done","queue_duration_s":1.121149,"scheduling_latency_s":1.121168,"redis_calls":10,"redis_duration_s":0.001742,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002263,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.048224,"completed_at":"2026-08-11T09:59:12.916Z","load_balancing_strategy":"primary","db_duration_s":0.026043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.242611] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:12.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4173d261890a4815b9e58436","created_at":"2026-08-11T09:59:11.777Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3071b0976ec63e4b36b313ef84d09177","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.801Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4173d261890a4815b9e58436: start","job_status":"start","queue_duration_s":1.115648,"scheduling_latency_s":1.115666} gitlab # [ 241.342005] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4173d261890a4815b9e58436","created_at":"2026-08-11T09:59:11.777Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3071b0976ec63e4b36b313ef84d09177","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.801Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4173d261890a4815b9e58436: done: 0.325196 sec","job_status":"done","queue_duration_s":1.115648,"scheduling_latency_s":1.115666,"redis_calls":565,"redis_duration_s":0.063111,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.062013,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.292601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004225,"duration_s":0.325196,"completed_at":"2026-08-11T09:59:13.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.412720] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7d58120743fbc50f5a817727","created_at":"2026-08-11T09:59:11.823Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ac896e5bb51d1c7017420a8a0a58f6a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.872Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7d58120743fbc50f5a817727: start","job_status":"start","queue_duration_s":1.371632,"scheduling_latency_s":1.371652} gitlab # [ 241.428980] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7d58120743fbc50f5a817727","created_at":"2026-08-11T09:59:11.823Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ac896e5bb51d1c7017420a8a0a58f6a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.872Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7d58120743fbc50f5a817727: done: 0.056474 sec","job_status":"done","queue_duration_s":1.371632,"scheduling_latency_s":1.371652,"redis_calls":12,"redis_duration_s":0.00331,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000537,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001276,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071136,"exclusive_lock_hold_duration_s":0.02605578,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.056474,"completed_at":"2026-08-11T09:59:13.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.474545] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4fc7c5e4fa426e831d2820ee","created_at":"2026-08-11T09:59:11.894Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09601e6c02c56cf889473b61787f841f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T09:59:11.905Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4fc7c5e4fa426e831d2820ee: start","job_status":"start","queue_duration_s":1.39703,"scheduling_latency_s":1.397046} gitlab # [ 241.488596] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4fc7c5e4fa426e831d2820ee","created_at":"2026-08-11T09:59:11.894Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09601e6c02c56cf889473b61787f841f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T09:59:11.905Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4fc7c5e4fa426e831d2820ee: done: 0.035507 sec","job_status":"done","queue_duration_s":1.39703,"scheduling_latency_s":1.397046,"redis_calls":10,"redis_duration_s":0.002519,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003787,"duration_s":0.035507,"completed_at":"2026-08-11T09:59:13.338Z","load_balancing_strategy":"primary","db_duration_s":0.006346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.530416] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fc015c8c8bd1eee93d734218","created_at":"2026-08-11T09:59:11.915Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73e731762f637d37c2ef4664b22773ce","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.931Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fc015c8c8bd1eee93d734218: start","job_status":"start","queue_duration_s":1.408425,"scheduling_latency_s":1.408442} gitlab # [ 241.544784] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"fc015c8c8bd1eee93d734218","created_at":"2026-08-11T09:59:11.915Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73e731762f637d37c2ef4664b22773ce","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.931Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-fc015c8c8bd1eee93d734218: done: 0.023927 sec","job_status":"done","queue_duration_s":1.408425,"scheduling_latency_s":1.408442,"redis_calls":12,"redis_duration_s":0.00287,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053362,"exclusive_lock_hold_duration_s":0.0041506,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023927,"completed_at":"2026-08-11T09:59:13.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.588680] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c3bc5a4d91f3cf4c3af8526b","created_at":"2026-08-11T09:59:11.940Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ccffa30c4acc93f128d7ab68b10b112","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.957Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c3bc5a4d91f3cf4c3af8526b: start","job_status":"start","queue_duration_s":1.407591,"scheduling_latency_s":1.407768} gitlab # [ 241.603419] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c3bc5a4d91f3cf4c3af8526b","created_at":"2026-08-11T09:59:11.940Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ccffa30c4acc93f128d7ab68b10b112","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:11.957Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c3bc5a4d91f3cf4c3af8526b: done: 0.049017 sec","job_status":"done","queue_duration_s":1.407591,"scheduling_latency_s":1.407768,"redis_calls":12,"redis_duration_s":0.00306,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057652,"exclusive_lock_hold_duration_s":0.02825604,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.049017,"completed_at":"2026-08-11T09:59:13.414Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.648970] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"622b809cf1c610df65f220be","created_at":"2026-08-11T09:59:11.998Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac6d2b1ba039ee6a15a8c9fb318725e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T09:59:12.012Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-622b809cf1c610df65f220be: start","job_status":"start","queue_duration_s":1.403782,"scheduling_latency_s":1.403798} gitlab # [ 241.662559] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.428Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 241.666364] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"622b809cf1c610df65f220be","created_at":"2026-08-11T09:59:11.998Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac6d2b1ba039ee6a15a8c9fb318725e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T09:59:12.012Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-622b809cf1c610df65f220be: done: 0.020757 sec","job_status":"done","queue_duration_s":1.403782,"scheduling_latency_s":1.403798,"redis_calls":10,"redis_duration_s":0.0024809999999999997,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031108,"duration_s":0.020757,"completed_at":"2026-08-11T09:59:13.436Z","load_balancing_strategy":"primary","db_duration_s":0.000732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.708433] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"22eda111153da13779a10454","created_at":"2026-08-11T09:59:12.030Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82d75bf240704277b20c0c3c1c936797","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.041Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-22eda111153da13779a10454: start","job_status":"start","queue_duration_s":1.396866,"scheduling_latency_s":1.396881} gitlab # [ 241.722848] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"22eda111153da13779a10454","created_at":"2026-08-11T09:59:12.030Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82d75bf240704277b20c0c3c1c936797","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.041Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-22eda111153da13779a10454: done: 0.019746 sec","job_status":"done","queue_duration_s":1.396866,"scheduling_latency_s":1.396881,"redis_calls":10,"redis_duration_s":0.002288,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000488,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032236,"duration_s":0.019746,"completed_at":"2026-08-11T09:59:13.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.764949] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.459Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ed777449590261865f64622","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ed777449590261865f64622: start","job_status":"start","queue_duration_s":1.325343,"scheduling_latency_s":1.325358} gitlab # [ 241.777201] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.588Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.778845] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.603Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ed777449590261865f64622","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ed777449590261865f64622: done: 0.14458 sec","job_status":"done","queue_duration_s":1.325343,"scheduling_latency_s":1.325358,"redis_calls":13,"redis_duration_s":0.0036469999999999996,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.113,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.113,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003193,"duration_s":0.14458,"completed_at":"2026-08-11T09:59:13.603Z","load_balancing_strategy":"primary","db_duration_s":0.005743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.819061] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.605Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1340fa748aceb596e23c05ab","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1340fa748aceb596e23c05ab: start","job_status":"start","queue_duration_s":1.471328,"scheduling_latency_s":1.471345} gitlab # [ 241.831462] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.616Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.833189] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.624Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1340fa748aceb596e23c05ab","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1340fa748aceb596e23c05ab: done: 0.019534 sec","job_status":"done","queue_duration_s":1.471328,"scheduling_latency_s":1.471345,"redis_calls":10,"redis_duration_s":0.002438,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019534,"completed_at":"2026-08-11T09:59:13.624Z","load_balancing_strategy":"primary","db_duration_s":0.002512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.871582] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.626Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"718c7ab9b324f255207e1a6f","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-718c7ab9b324f255207e1a6f: start","job_status":"start","queue_duration_s":1.492666,"scheduling_latency_s":1.492683} gitlab # [ 241.883862] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.638Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.886590] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.646Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"718c7ab9b324f255207e1a6f","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-718c7ab9b324f255207e1a6f: done: 0.019956 sec","job_status":"done","queue_duration_s":1.492666,"scheduling_latency_s":1.492683,"redis_calls":10,"redis_duration_s":0.002456,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001422,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019956,"completed_at":"2026-08-11T09:59:13.646Z","load_balancing_strategy":"primary","db_duration_s":0.002441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.924861] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.649Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"53c15087f9374027bd54f0fb","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-53c15087f9374027bd54f0fb: start","job_status":"start","queue_duration_s":1.515014,"scheduling_latency_s":1.515031} gitlab # [ 241.937133] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.660Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.938793] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.670Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"53c15087f9374027bd54f0fb","created_at":"2026-08-11T09:59:12.101Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-ae7ab7e5daea42f3","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fc4058130bf8e71399fb38c7cf7246b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.134Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-53c15087f9374027bd54f0fb: done: 0.020945 sec","job_status":"done","queue_duration_s":1.515014,"scheduling_latency_s":1.515031,"redis_calls":10,"redis_duration_s":0.002533,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001441,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020945,"completed_at":"2026-08-11T09:59:13.669Z","load_balancing_strategy":"primary","db_duration_s":0.003343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.977031] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5f221faa3df0d4055bf7d6f","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5f221faa3df0d4055bf7d6f: start","job_status":"start","queue_duration_s":0.916907,"scheduling_latency_s":0.916923} gitlab # [ 241.989491] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5f221faa3df0d4055bf7d6f","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5f221faa3df0d4055bf7d6f: done: 0.022671 sec","job_status":"done","queue_duration_s":0.916907,"scheduling_latency_s":0.916923,"redis_calls":16,"redis_duration_s":0.004006,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067084,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022671,"completed_at":"2026-08-11T09:59:13.694Z","load_balancing_strategy":"primary","db_duration_s":0.000624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.030391] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"837d5e319af8171d417ef369","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-837d5e319af8171d417ef369: start","job_status":"start","queue_duration_s":0.94098,"scheduling_latency_s":0.940996} gitlab # [ 242.042945] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"837d5e319af8171d417ef369","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-837d5e319af8171d417ef369: done: 0.015728 sec","job_status":"done","queue_duration_s":0.94098,"scheduling_latency_s":0.940996,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015728,"completed_at":"2026-08-11T09:59:13.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.084997] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2878080904e3741ffd997ee8","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2878080904e3741ffd997ee8: start","job_status":"start","queue_duration_s":0.958037,"scheduling_latency_s":0.958053} gitlab # [ 242.098871] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2878080904e3741ffd997ee8","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2878080904e3741ffd997ee8: done: 0.015638 sec","job_status":"done","queue_duration_s":0.958037,"scheduling_latency_s":0.958053,"redis_calls":13,"redis_duration_s":0.0027930000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015638,"completed_at":"2026-08-11T09:59:13.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.140583] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d87ee335b2ad75817dbf724","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d87ee335b2ad75817dbf724: start","job_status":"start","queue_duration_s":0.975653,"scheduling_latency_s":0.975668} gitlab # [ 242.153024] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d87ee335b2ad75817dbf724","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d87ee335b2ad75817dbf724: done: 0.015422 sec","job_status":"done","queue_duration_s":0.975653,"scheduling_latency_s":0.975668,"redis_calls":13,"redis_duration_s":0.002602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015422,"completed_at":"2026-08-11T09:59:13.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.192198] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13de5357fde95ebbddfadd32","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13de5357fde95ebbddfadd32: start","job_status":"start","queue_duration_s":0.992421,"scheduling_latency_s":0.992436} gitlab # [ 242.204233] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13de5357fde95ebbddfadd32","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13de5357fde95ebbddfadd32: done: 0.015582 sec","job_status":"done","queue_duration_s":0.992421,"scheduling_latency_s":0.992436,"redis_calls":13,"redis_duration_s":0.003195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015582,"completed_at":"2026-08-11T09:59:13.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.243173] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b80b14da684a2b8412a7b9a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b80b14da684a2b8412a7b9a: start","job_status":"start","queue_duration_s":1.009389,"scheduling_latency_s":1.009405} gitlab # [ 242.255613] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b80b14da684a2b8412a7b9a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b80b14da684a2b8412a7b9a: done: 0.01514 sec","job_status":"done","queue_duration_s":1.009389,"scheduling_latency_s":1.009405,"redis_calls":13,"redis_duration_s":0.0024939999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01514,"completed_at":"2026-08-11T09:59:13.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.296566] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed39aca95dea2aa1e05b95e","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed39aca95dea2aa1e05b95e: start","job_status":"start","queue_duration_s":1.025811,"scheduling_latency_s":1.025827} gitlab # [ 242.308712] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed39aca95dea2aa1e05b95e","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed39aca95dea2aa1e05b95e: done: 0.015769 sec","job_status":"done","queue_duration_s":1.025811,"scheduling_latency_s":1.025827,"redis_calls":13,"redis_duration_s":0.003043,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015769,"completed_at":"2026-08-11T09:59:13.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.348231] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0afbc9f40b28d4e39a158e51","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0afbc9f40b28d4e39a158e51: start","job_status":"start","queue_duration_s":1.04376,"scheduling_latency_s":1.043776} gitlab # [ 242.360559] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0afbc9f40b28d4e39a158e51","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0afbc9f40b28d4e39a158e51: done: 0.01599 sec","job_status":"done","queue_duration_s":1.04376,"scheduling_latency_s":1.043776,"redis_calls":13,"redis_duration_s":0.002717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01599,"completed_at":"2026-08-11T09:59:13.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.399299] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ff407481485169aeafd606","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ff407481485169aeafd606: start","job_status":"start","queue_duration_s":1.061118,"scheduling_latency_s":1.061133} gitlab # [ 242.411829] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ff407481485169aeafd606","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ff407481485169aeafd606: done: 0.015411 sec","job_status":"done","queue_duration_s":1.061118,"scheduling_latency_s":1.061133,"redis_calls":13,"redis_duration_s":0.002641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015411,"completed_at":"2026-08-11T09:59:13.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.451198] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89c9d00db36ce09a2b28c3a3","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89c9d00db36ce09a2b28c3a3: start","job_status":"start","queue_duration_s":1.077828,"scheduling_latency_s":1.077843} gitlab # [ 242.463581] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89c9d00db36ce09a2b28c3a3","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89c9d00db36ce09a2b28c3a3: done: 0.016012 sec","job_status":"done","queue_duration_s":1.077828,"scheduling_latency_s":1.077843,"redis_calls":13,"redis_duration_s":0.002739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016012,"completed_at":"2026-08-11T09:59:13.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.503461] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0aae888b399f8ace6adce1c","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0aae888b399f8ace6adce1c: start","job_status":"start","queue_duration_s":1.095347,"scheduling_latency_s":1.095363} gitlab # [ 242.515963] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0aae888b399f8ace6adce1c","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0aae888b399f8ace6adce1c: done: 0.015674 sec","job_status":"done","queue_duration_s":1.095347,"scheduling_latency_s":1.095363,"redis_calls":13,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015674,"completed_at":"2026-08-11T09:59:13.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.555650] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35bed392f4632a6e1ff5f6e9","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35bed392f4632a6e1ff5f6e9: start","job_status":"start","queue_duration_s":1.113123,"scheduling_latency_s":1.113139} gitlab # [ 242.568254] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35bed392f4632a6e1ff5f6e9","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35bed392f4632a6e1ff5f6e9: done: 0.018799 sec","job_status":"done","queue_duration_s":1.113123,"scheduling_latency_s":1.113139,"redis_calls":13,"redis_duration_s":0.005723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018799,"completed_at":"2026-08-11T09:59:13.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.607129] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"898a712f6564f36252203350","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-898a712f6564f36252203350: start","job_status":"start","queue_duration_s":1.133288,"scheduling_latency_s":1.133303} gitlab # [ 242.619732] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"898a712f6564f36252203350","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-898a712f6564f36252203350: done: 0.027833 sec","job_status":"done","queue_duration_s":1.133288,"scheduling_latency_s":1.133303,"redis_calls":13,"redis_duration_s":0.008602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027833,"completed_at":"2026-08-11T09:59:13.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.658904] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"252cb8afa47b5806b6e4b2ce","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-252cb8afa47b5806b6e4b2ce: start","job_status":"start","queue_duration_s":1.162405,"scheduling_latency_s":1.162423} gitlab # [ 242.671418] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"252cb8afa47b5806b6e4b2ce","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-252cb8afa47b5806b6e4b2ce: done: 0.025979 sec","job_status":"done","queue_duration_s":1.162405,"scheduling_latency_s":1.162423,"redis_calls":13,"redis_duration_s":0.008548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025979,"completed_at":"2026-08-11T09:59:13.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.711513] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64569c2e6b4e2453b2e10586","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64569c2e6b4e2453b2e10586: start","job_status":"start","queue_duration_s":1.192999,"scheduling_latency_s":1.193035} gitlab # [ 242.723824] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64569c2e6b4e2453b2e10586","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64569c2e6b4e2453b2e10586: done: 0.023695 sec","job_status":"done","queue_duration_s":1.192999,"scheduling_latency_s":1.193035,"redis_calls":13,"redis_duration_s":0.003188,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023695,"completed_at":"2026-08-11T09:59:13.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.762939] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"435f0c8866116b5ca5f126e5","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-435f0c8866116b5ca5f126e5: start","job_status":"start","queue_duration_s":1.218352,"scheduling_latency_s":1.218378} gitlab # [ 242.775366] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"435f0c8866116b5ca5f126e5","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-435f0c8866116b5ca5f126e5: done: 0.01735 sec","job_status":"done","queue_duration_s":1.218352,"scheduling_latency_s":1.218378,"redis_calls":13,"redis_duration_s":0.0028209999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01735,"completed_at":"2026-08-11T09:59:13.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.814359] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:13.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fb2b148c9cdaf6f538c5758","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fb2b148c9cdaf6f538c5758: start","job_status":"start","queue_duration_s":1.238022,"scheduling_latency_s":1.238048} gitlab # [ 242.826835] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fb2b148c9cdaf6f538c5758","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fb2b148c9cdaf6f538c5758: done: 0.017675 sec","job_status":"done","queue_duration_s":1.238022,"scheduling_latency_s":1.238048,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017675,"completed_at":"2026-08-11T09:59:14.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.865702] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6062be5ea9d89ba8f3584170","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6062be5ea9d89ba8f3584170: start","job_status":"start","queue_duration_s":1.257356,"scheduling_latency_s":1.257381} gitlab # [ 242.877891] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6062be5ea9d89ba8f3584170","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6062be5ea9d89ba8f3584170: done: 0.01965 sec","job_status":"done","queue_duration_s":1.257356,"scheduling_latency_s":1.257381,"redis_calls":13,"redis_duration_s":0.005932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01965,"completed_at":"2026-08-11T09:59:14.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.917561] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b81eb2aed41307c60c3980b2","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b81eb2aed41307c60c3980b2: start","job_status":"start","queue_duration_s":1.278959,"scheduling_latency_s":1.278974} gitlab # [ 242.929835] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b81eb2aed41307c60c3980b2","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b81eb2aed41307c60c3980b2: done: 0.01628 sec","job_status":"done","queue_duration_s":1.278959,"scheduling_latency_s":1.278974,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01628,"completed_at":"2026-08-11T09:59:14.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.968476] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143117f7976f224887bb776a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143117f7976f224887bb776a: start","job_status":"start","queue_duration_s":1.296569,"scheduling_latency_s":1.296584} gitlab # [ 242.980757] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143117f7976f224887bb776a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143117f7976f224887bb776a: done: 0.015798 sec","job_status":"done","queue_duration_s":1.296569,"scheduling_latency_s":1.296584,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015798,"completed_at":"2026-08-11T09:59:14.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.019640] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08c89d4b66f004bb1433ad8d","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08c89d4b66f004bb1433ad8d: start","job_status":"start","queue_duration_s":1.313682,"scheduling_latency_s":1.313697} gitlab # [ 243.032506] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08c89d4b66f004bb1433ad8d","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08c89d4b66f004bb1433ad8d: done: 0.015072 sec","job_status":"done","queue_duration_s":1.313682,"scheduling_latency_s":1.313697,"redis_calls":13,"redis_duration_s":0.0025210000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015072,"completed_at":"2026-08-11T09:59:14.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.071666] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68558ecaf65df6d9eab48050","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68558ecaf65df6d9eab48050: start","job_status":"start","queue_duration_s":1.330132,"scheduling_latency_s":1.330147} gitlab # [ 243.084198] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68558ecaf65df6d9eab48050","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68558ecaf65df6d9eab48050: done: 0.017288 sec","job_status":"done","queue_duration_s":1.330132,"scheduling_latency_s":1.330147,"redis_calls":13,"redis_duration_s":0.0031000000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017288,"completed_at":"2026-08-11T09:59:14.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.124351] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23067dac6c9dc0b48dbb6b25","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23067dac6c9dc0b48dbb6b25: start","job_status":"start","queue_duration_s":1.348801,"scheduling_latency_s":1.348816} gitlab # [ 243.136375] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23067dac6c9dc0b48dbb6b25","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23067dac6c9dc0b48dbb6b25: done: 0.015543 sec","job_status":"done","queue_duration_s":1.348801,"scheduling_latency_s":1.348816,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015543,"completed_at":"2026-08-11T09:59:14.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.174925] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f9a8b98c9e515f103c68b6","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f9a8b98c9e515f103c68b6: start","job_status":"start","queue_duration_s":1.365685,"scheduling_latency_s":1.365699} gitlab # [ 243.187323] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f9a8b98c9e515f103c68b6","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f9a8b98c9e515f103c68b6: done: 0.01535 sec","job_status":"done","queue_duration_s":1.365685,"scheduling_latency_s":1.365699,"redis_calls":13,"redis_duration_s":0.002619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01535,"completed_at":"2026-08-11T09:59:14.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.225982] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7fa07ee071b566d30cfcc9","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7fa07ee071b566d30cfcc9: start","job_status":"start","queue_duration_s":1.382321,"scheduling_latency_s":1.382336} gitlab # [ 243.238407] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7fa07ee071b566d30cfcc9","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7fa07ee071b566d30cfcc9: done: 0.015375 sec","job_status":"done","queue_duration_s":1.382321,"scheduling_latency_s":1.382336,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015375,"completed_at":"2026-08-11T09:59:14.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.276969] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08d585ed87d9932f4b7dfbca","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08d585ed87d9932f4b7dfbca: start","job_status":"start","queue_duration_s":1.399651,"scheduling_latency_s":1.399667} gitlab # [ 243.289034] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08d585ed87d9932f4b7dfbca","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08d585ed87d9932f4b7dfbca: done: 0.01523 sec","job_status":"done","queue_duration_s":1.399651,"scheduling_latency_s":1.399667,"redis_calls":13,"redis_duration_s":0.002533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001619,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01523,"completed_at":"2026-08-11T09:59:14.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.328565] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"087880884a62e4a9e6269ff1","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-087880884a62e4a9e6269ff1: start","job_status":"start","queue_duration_s":1.416131,"scheduling_latency_s":1.416145} gitlab # [ 243.340696] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"087880884a62e4a9e6269ff1","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-087880884a62e4a9e6269ff1: done: 0.015197 sec","job_status":"done","queue_duration_s":1.416131,"scheduling_latency_s":1.416145,"redis_calls":13,"redis_duration_s":0.003178,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015197,"completed_at":"2026-08-11T09:59:14.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.379820] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dec8bd8988ad3be3525a16a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dec8bd8988ad3be3525a16a: start","job_status":"start","queue_duration_s":1.432663,"scheduling_latency_s":1.432678} gitlab # [ 243.392599] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dec8bd8988ad3be3525a16a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dec8bd8988ad3be3525a16a: done: 0.01601 sec","job_status":"done","queue_duration_s":1.432663,"scheduling_latency_s":1.432678,"redis_calls":13,"redis_duration_s":0.00309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01601,"completed_at":"2026-08-11T09:59:14.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.432100] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e660d4fa8e41b83c560e760","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e660d4fa8e41b83c560e760: start","job_status":"start","queue_duration_s":1.44997,"scheduling_latency_s":1.449985} gitlab # [ 243.444392] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e660d4fa8e41b83c560e760","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e660d4fa8e41b83c560e760: done: 0.01542 sec","job_status":"done","queue_duration_s":1.44997,"scheduling_latency_s":1.449985,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01542,"completed_at":"2026-08-11T09:59:14.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.484071] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42be0ac8e55658d868c7a58b","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42be0ac8e55658d868c7a58b: start","job_status":"start","queue_duration_s":1.467392,"scheduling_latency_s":1.467406} gitlab # [ 243.496567] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42be0ac8e55658d868c7a58b","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42be0ac8e55658d868c7a58b: done: 0.016162 sec","job_status":"done","queue_duration_s":1.467392,"scheduling_latency_s":1.467406,"redis_calls":13,"redis_duration_s":0.002635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016162,"completed_at":"2026-08-11T09:59:14.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.536825] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58f824305c13f403f936a08b","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58f824305c13f403f936a08b: start","job_status":"start","queue_duration_s":1.48493,"scheduling_latency_s":1.484944} gitlab # [ 243.548921] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58f824305c13f403f936a08b","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58f824305c13f403f936a08b: done: 0.016079 sec","job_status":"done","queue_duration_s":1.48493,"scheduling_latency_s":1.484944,"redis_calls":13,"redis_duration_s":0.002701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016079,"completed_at":"2026-08-11T09:59:14.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.588268] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16395659eb1f582988bf4c08","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16395659eb1f582988bf4c08: start","job_status":"start","queue_duration_s":1.502357,"scheduling_latency_s":1.502372} gitlab # [ 243.600727] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16395659eb1f582988bf4c08","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16395659eb1f582988bf4c08: done: 0.015834 sec","job_status":"done","queue_duration_s":1.502357,"scheduling_latency_s":1.502372,"redis_calls":13,"redis_duration_s":0.0025210000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015834,"completed_at":"2026-08-11T09:59:14.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.640135] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bda6dd0df30cf9492cf3f81","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bda6dd0df30cf9492cf3f81: start","job_status":"start","queue_duration_s":1.519472,"scheduling_latency_s":1.519488} gitlab # [ 243.652612] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bda6dd0df30cf9492cf3f81","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bda6dd0df30cf9492cf3f81: done: 0.015818 sec","job_status":"done","queue_duration_s":1.519472,"scheduling_latency_s":1.519488,"redis_calls":13,"redis_duration_s":0.0025789999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015818,"completed_at":"2026-08-11T09:59:14.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.692172] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e042896286d8eb3ff9220c43","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e042896286d8eb3ff9220c43: start","job_status":"start","queue_duration_s":1.537167,"scheduling_latency_s":1.537183} gitlab # [ 243.704337] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e042896286d8eb3ff9220c43","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e042896286d8eb3ff9220c43: done: 0.015754 sec","job_status":"done","queue_duration_s":1.537167,"scheduling_latency_s":1.537183,"redis_calls":13,"redis_duration_s":0.002733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015754,"completed_at":"2026-08-11T09:59:14.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.744378] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"315be4ca95e8095a557becbf","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-315be4ca95e8095a557becbf: start","job_status":"start","queue_duration_s":1.554288,"scheduling_latency_s":1.554303} gitlab # [ 243.756595] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"315be4ca95e8095a557becbf","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-315be4ca95e8095a557becbf: done: 0.015734 sec","job_status":"done","queue_duration_s":1.554288,"scheduling_latency_s":1.554303,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015734,"completed_at":"2026-08-11T09:59:14.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.795702] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16d8b3f3c2796f8e6dfb343a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16d8b3f3c2796f8e6dfb343a: start","job_status":"start","queue_duration_s":1.571375,"scheduling_latency_s":1.571389} gitlab # [ 243.808458] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16d8b3f3c2796f8e6dfb343a","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16d8b3f3c2796f8e6dfb343a: done: 0.016126 sec","job_status":"done","queue_duration_s":1.571375,"scheduling_latency_s":1.571389,"redis_calls":13,"redis_duration_s":0.002578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016126,"completed_at":"2026-08-11T09:59:14.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.847446] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20542ad827d1bdd7a7b895f6","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20542ad827d1bdd7a7b895f6: start","job_status":"start","queue_duration_s":1.588885,"scheduling_latency_s":1.5889} gitlab # [ 243.859953] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20542ad827d1bdd7a7b895f6","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20542ad827d1bdd7a7b895f6: done: 0.015349 sec","job_status":"done","queue_duration_s":1.588885,"scheduling_latency_s":1.5889,"redis_calls":13,"redis_duration_s":0.002633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015349,"completed_at":"2026-08-11T09:59:14.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.899947] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8d4e778758bb5f1d2513e0","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8d4e778758bb5f1d2513e0: start","job_status":"start","queue_duration_s":1.606086,"scheduling_latency_s":1.606101} gitlab # [ 243.912619] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8d4e778758bb5f1d2513e0","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8d4e778758bb5f1d2513e0: done: 0.017375 sec","job_status":"done","queue_duration_s":1.606086,"scheduling_latency_s":1.606101,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001674,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017375,"completed_at":"2026-08-11T09:59:14.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.952546] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5466d38f2c2ea8d5df1c864f","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5466d38f2c2ea8d5df1c864f: start","job_status":"start","queue_duration_s":1.624841,"scheduling_latency_s":1.624856} gitlab # [ 243.964922] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5466d38f2c2ea8d5df1c864f","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5466d38f2c2ea8d5df1c864f: done: 0.016098 sec","job_status":"done","queue_duration_s":1.624841,"scheduling_latency_s":1.624856,"redis_calls":13,"redis_duration_s":0.002722,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016098,"completed_at":"2026-08-11T09:59:14.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.004271] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"805107980afe3d7dd70748bd","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-805107980afe3d7dd70748bd: start","job_status":"start","queue_duration_s":1.642282,"scheduling_latency_s":1.642298} gitlab # [ 244.016403] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"805107980afe3d7dd70748bd","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-805107980afe3d7dd70748bd: done: 0.015587 sec","job_status":"done","queue_duration_s":1.642282,"scheduling_latency_s":1.642298,"redis_calls":13,"redis_duration_s":0.002763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015587,"completed_at":"2026-08-11T09:59:14.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.055660] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4595565e244ca26f27e83184","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4595565e244ca26f27e83184: start","job_status":"start","queue_duration_s":1.659219,"scheduling_latency_s":1.659233} gitlab # [ 244.068429] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4595565e244ca26f27e83184","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4595565e244ca26f27e83184: done: 0.017048 sec","job_status":"done","queue_duration_s":1.659219,"scheduling_latency_s":1.659233,"redis_calls":13,"redis_duration_s":0.002872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017048,"completed_at":"2026-08-11T09:59:14.430Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.107645] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4be868f198f6d2b37eb81bf","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4be868f198f6d2b37eb81bf: start","job_status":"start","queue_duration_s":1.677653,"scheduling_latency_s":1.677668} gitlab # [ 244.120415] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4be868f198f6d2b37eb81bf","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4be868f198f6d2b37eb81bf: done: 0.01619 sec","job_status":"done","queue_duration_s":1.677653,"scheduling_latency_s":1.677668,"redis_calls":13,"redis_duration_s":0.002362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01619,"completed_at":"2026-08-11T09:59:14.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.160584] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e3136dafff81537734c01fb","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e3136dafff81537734c01fb: start","job_status":"start","queue_duration_s":1.695091,"scheduling_latency_s":1.695106} gitlab # [ 244.173194] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e3136dafff81537734c01fb","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e3136dafff81537734c01fb: done: 0.016158 sec","job_status":"done","queue_duration_s":1.695091,"scheduling_latency_s":1.695106,"redis_calls":13,"redis_duration_s":0.002559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001644,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016158,"completed_at":"2026-08-11T09:59:14.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.212616] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89553b280c24e2577ffe3dda","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89553b280c24e2577ffe3dda: start","job_status":"start","queue_duration_s":1.712623,"scheduling_latency_s":1.712638} gitlab # [ 244.225284] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89553b280c24e2577ffe3dda","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89553b280c24e2577ffe3dda: done: 0.016066 sec","job_status":"done","queue_duration_s":1.712623,"scheduling_latency_s":1.712638,"redis_calls":13,"redis_duration_s":0.002591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001709,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016066,"completed_at":"2026-08-11T09:59:14.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.264545] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ddf5383c30f6be2eb9c033","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ddf5383c30f6be2eb9c033: start","job_status":"start","queue_duration_s":1.729985,"scheduling_latency_s":1.730912} gitlab # [ 244.276660] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22ddf5383c30f6be2eb9c033","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22ddf5383c30f6be2eb9c033: done: 0.017632 sec","job_status":"done","queue_duration_s":1.729985,"scheduling_latency_s":1.730912,"redis_calls":13,"redis_duration_s":0.003017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017632,"completed_at":"2026-08-11T09:59:14.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.316107] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"949db7b62bac58ba7875d219","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-949db7b62bac58ba7875d219: start","job_status":"start","queue_duration_s":1.748972,"scheduling_latency_s":1.748987} gitlab # [ 244.328378] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"949db7b62bac58ba7875d219","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-949db7b62bac58ba7875d219: done: 0.015466 sec","job_status":"done","queue_duration_s":1.748972,"scheduling_latency_s":1.748987,"redis_calls":13,"redis_duration_s":0.002677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015466,"completed_at":"2026-08-11T09:59:14.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.367938] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"204bf656d256f897af44b93c","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-204bf656d256f897af44b93c: start","job_status":"start","queue_duration_s":1.765864,"scheduling_latency_s":1.76588} gitlab # [ 244.380551] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"204bf656d256f897af44b93c","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-204bf656d256f897af44b93c: done: 0.015345 sec","job_status":"done","queue_duration_s":1.765864,"scheduling_latency_s":1.76588,"redis_calls":13,"redis_duration_s":0.0032199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001672,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015345,"completed_at":"2026-08-11T09:59:14.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.419409] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68e76b9c9fc5dbb1d6e61e26","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68e76b9c9fc5dbb1d6e61e26: start","job_status":"start","queue_duration_s":1.782522,"scheduling_latency_s":1.782537} gitlab # [ 244.431758] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68e76b9c9fc5dbb1d6e61e26","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68e76b9c9fc5dbb1d6e61e26: done: 0.015376 sec","job_status":"done","queue_duration_s":1.782522,"scheduling_latency_s":1.782537,"redis_calls":13,"redis_duration_s":0.0025700000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001691,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015376,"completed_at":"2026-08-11T09:59:14.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.471016] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ae67d8fa835e06ec8cc79ef","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ae67d8fa835e06ec8cc79ef: start","job_status":"start","queue_duration_s":1.799279,"scheduling_latency_s":1.799295} gitlab # [ 244.483357] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ae67d8fa835e06ec8cc79ef","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ae67d8fa835e06ec8cc79ef: done: 0.015905 sec","job_status":"done","queue_duration_s":1.799279,"scheduling_latency_s":1.799295,"redis_calls":13,"redis_duration_s":0.002618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001709,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015905,"completed_at":"2026-08-11T09:59:14.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.522643] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fb2e3419ece8ca91a520eb7","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fb2e3419ece8ca91a520eb7: start","job_status":"start","queue_duration_s":1.816495,"scheduling_latency_s":1.816509} gitlab # [ 244.535203] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T09:59:14.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fb2e3419ece8ca91a520eb7","created_at":"2026-08-11T09:59:12.663Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-370cf1a8afed416f","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b279151dbd65210e101bc42dab96f1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:59:12.754Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fb2e3419ece8ca91a520eb7: done: 0.014903 sec","job_status":"done","queue_duration_s":1.816495,"scheduling_latency_s":1.816509,"redis_calls":13,"redis_duration_s":0.002588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001709,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014903,"completed_at":"2026-08-11T09:59:14.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.936490] setup-gitlab-start[2984]: W, [2026-08-11T09:59:45.836502 #2984] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 288.158904] systemd[1]: Starting Logrotate Service... gitlab # [ 288.306420] systemd[1]: logrotate.service: Deactivated successfully. gitlab # [ 288.309490] systemd[1]: Finished Logrotate Service. gitlab # [ 289.830542] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:01.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d5ae9ab08e234b164b14c4fa","created_at":"2026-08-11T10:00:01.709Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8f43700270e97aab78de34d5fa770f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.726Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d5ae9ab08e234b164b14c4fa: start","job_status":"start","queue_duration_s":0.003354,"scheduling_latency_s":0.003411} gitlab # [ 289.885261] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:01.786Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 289.921077] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:01.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d5ae9ab08e234b164b14c4fa","created_at":"2026-08-11T10:00:01.709Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8f43700270e97aab78de34d5fa770f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.726Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d5ae9ab08e234b164b14c4fa: done: 0.091202 sec","job_status":"done","queue_duration_s":0.003354,"scheduling_latency_s":0.003411,"redis_calls":13,"redis_duration_s":0.026404,"redis_read_bytes":773,"redis_write_bytes":1171,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.009813,"redis_feature_flag_read_bytes":768,"redis_feature_flag_write_bytes":400,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011975,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004616,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091202,"completed_at":"2026-08-11T10:00:01.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.004165] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:01.830Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"21f855caf4b2d043e90c5ccc","created_at":"2026-08-11T10:00:01.747Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a3b39c1d1071d24bf460f00ced6a70d","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.781Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-21f855caf4b2d043e90c5ccc: start","job_status":"start","queue_duration_s":0.04815,"scheduling_latency_s":0.048199} gitlab # [ 290.134795] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"21f855caf4b2d043e90c5ccc","created_at":"2026-08-11T10:00:01.747Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a3b39c1d1071d24bf460f00ced6a70d","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.781Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-21f855caf4b2d043e90c5ccc: done: 0.204809 sec","job_status":"done","queue_duration_s":0.04815,"scheduling_latency_s":0.048199,"redis_calls":11,"redis_duration_s":0.044421999999999996,"redis_read_bytes":137,"redis_write_bytes":1104,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.006399,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":352,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.033794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00255528,"duration_s":0.204809,"completed_at":"2026-08-11T10:00:02.034Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.216828] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.046Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"019bb447ddfe19a4bf68d79e","created_at":"2026-08-11T10:00:01.803Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93d84634f127c14342b0f1b05c39260d","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.827Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-019bb447ddfe19a4bf68d79e: start","job_status":"start","queue_duration_s":0.218875,"scheduling_latency_s":0.218922} gitlab # [ 290.277689] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"019bb447ddfe19a4bf68d79e","created_at":"2026-08-11T10:00:01.803Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93d84634f127c14342b0f1b05c39260d","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.827Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-019bb447ddfe19a4bf68d79e: done: 0.131342 sec","job_status":"done","queue_duration_s":0.218875,"scheduling_latency_s":0.218922,"redis_calls":12,"redis_duration_s":0.022146,"redis_read_bytes":11,"redis_write_bytes":1392,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010636,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003563,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005069,"duration_s":0.131342,"completed_at":"2026-08-11T10:00:02.177Z","load_balancing_strategy":"primary","db_duration_s":0.038637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.360489] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8e36b4f2d9671f45a6d01c07","created_at":"2026-08-11T10:00:01.841Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20aa1a0b7c681021a562eeec2c6204d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.847Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8e36b4f2d9671f45a6d01c07: start","job_status":"start","queue_duration_s":0.333697,"scheduling_latency_s":0.333737} gitlab # [ 290.377871] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.250Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 290.403150] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8e36b4f2d9671f45a6d01c07","created_at":"2026-08-11T10:00:01.841Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20aa1a0b7c681021a562eeec2c6204d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.847Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8e36b4f2d9671f45a6d01c07: done: 0.120148 sec","job_status":"done","queue_duration_s":0.333697,"scheduling_latency_s":0.333737,"redis_calls":7,"redis_duration_s":0.002477,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120148,"completed_at":"2026-08-11T10:00:02.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.447834] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.321Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"57b1969fdbe8c97f4f26bd28","created_at":"2026-08-11T10:00:01.897Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"3d8c3c987423be0443c88bba1f16eefb","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.923Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-57b1969fdbe8c97f4f26bd28: start","job_status":"start","queue_duration_s":0.397488,"scheduling_latency_s":0.397539} gitlab # [ 290.574603] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"57b1969fdbe8c97f4f26bd28","created_at":"2026-08-11T10:00:01.897Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"3d8c3c987423be0443c88bba1f16eefb","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.923Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-57b1969fdbe8c97f4f26bd28: done: 0.153521 sec","job_status":"done","queue_duration_s":0.397488,"scheduling_latency_s":0.397539,"redis_calls":10,"redis_duration_s":0.025494000000000003,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003764,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.011948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00178256,"duration_s":0.153521,"completed_at":"2026-08-11T10:00:02.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.670865] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"e107d9f74b01d206b8ae10d2","created_at":"2026-08-11T10:00:01.936Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.955Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-e107d9f74b01d206b8ae10d2: start","job_status":"start","queue_duration_s":0.531998,"scheduling_latency_s":0.532044} gitlab # [ 290.761070] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"e107d9f74b01d206b8ae10d2","created_at":"2026-08-11T10:00:01.936Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.955Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-e107d9f74b01d206b8ae10d2: done: 0.173662 sec","job_status":"done","queue_duration_s":0.531998,"scheduling_latency_s":0.532044,"redis_calls":24,"redis_duration_s":0.043618000000000004,"redis_read_bytes":25,"redis_write_bytes":5977,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004508,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.00489,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3810,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.017001,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.017219,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00143214,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.173662,"completed_at":"2026-08-11T10:00:02.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.858375] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.667Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6897a719bdfc2b96b0df4510","created_at":"2026-08-11T10:00:01.961Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf1c305af2ce3eb9fbb1a8e45fe756c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.966Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6897a719bdfc2b96b0df4510: start","job_status":"start","queue_duration_s":0.700131,"scheduling_latency_s":0.700178} gitlab # [ 290.877540] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6897a719bdfc2b96b0df4510","created_at":"2026-08-11T10:00:01.961Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf1c305af2ce3eb9fbb1a8e45fe756c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.966Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6897a719bdfc2b96b0df4510: done: 0.068764 sec","job_status":"done","queue_duration_s":0.700131,"scheduling_latency_s":0.700178,"redis_calls":9,"redis_duration_s":0.014621,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101786,"exclusive_lock_hold_duration_s":0.00737784,"duration_s":0.068764,"completed_at":"2026-08-11T10:00:02.735Z","load_balancing_strategy":"primary","db_duration_s":0.003248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.929044] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"17d9031bac6bd8fefca6f519","created_at":"2026-08-11T10:00:01.979Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.986Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-17d9031bac6bd8fefca6f519: start","job_status":"start","queue_duration_s":0.763511,"scheduling_latency_s":0.763558} gitlab # [ 290.971779] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"17d9031bac6bd8fefca6f519","created_at":"2026-08-11T10:00:01.979Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:01.986Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-17d9031bac6bd8fefca6f519: done: 0.122128 sec","job_status":"done","queue_duration_s":0.763511,"scheduling_latency_s":0.763558,"redis_calls":14,"redis_duration_s":0.025036,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.001733,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.016558,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006745,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.122128,"completed_at":"2026-08-11T10:00:02.871Z","load_balancing_strategy":"primary","db_duration_s":0.001176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.030664] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:02.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"de8104382cc6c43d2cff4eef","created_at":"2026-08-11T10:00:02.007Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.031Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-de8104382cc6c43d2cff4eef: start","job_status":"start","queue_duration_s":0.844884,"scheduling_latency_s":0.84493} gitlab # [ 291.256215] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"de8104382cc6c43d2cff4eef","created_at":"2026-08-11T10:00:02.007Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.031Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-de8104382cc6c43d2cff4eef: done: 0.279746 sec","job_status":"done","queue_duration_s":0.844884,"scheduling_latency_s":0.84493,"redis_calls":28,"redis_duration_s":0.097892,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.041688,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.003702,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.038448,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.014054,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00171502,"duration_s":0.279746,"completed_at":"2026-08-11T10:00:03.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.355052] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"64170708b14d33e40157cb7b","created_at":"2026-08-11T10:00:02.045Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.078Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-64170708b14d33e40157cb7b: start","job_status":"start","queue_duration_s":1.107396,"scheduling_latency_s":1.107443} gitlab # [ 291.693287] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"64170708b14d33e40157cb7b","created_at":"2026-08-11T10:00:02.045Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.078Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-64170708b14d33e40157cb7b: done: 0.408404 sec","job_status":"done","queue_duration_s":1.107396,"scheduling_latency_s":1.107443,"redis_calls":65,"redis_duration_s":0.077828,"redis_read_bytes":115,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00326,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000903,"redis_queues_read_bytes":4,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.072734,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036382,"duration_s":0.408404,"completed_at":"2026-08-11T10:00:03.593Z","load_balancing_strategy":"primary","db_duration_s":0.007164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.790263] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b7fbad315570b672ab920c01","created_at":"2026-08-11T10:00:02.106Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1685bb5d8a75ede9a0135d35af588c21","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.119Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b7fbad315570b672ab920c01: start","job_status":"start","queue_duration_s":1.476389,"scheduling_latency_s":1.476409} gitlab # [ 291.808240] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b7fbad315570b672ab920c01","created_at":"2026-08-11T10:00:02.106Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1685bb5d8a75ede9a0135d35af588c21","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.119Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b7fbad315570b672ab920c01: done: 0.037408 sec","job_status":"done","queue_duration_s":1.476389,"scheduling_latency_s":1.476409,"redis_calls":7,"redis_duration_s":0.002034,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037408,"completed_at":"2026-08-11T10:00:03.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.850121] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2e65ed31bdacde5ef0587620","created_at":"2026-08-11T10:00:02.125Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b74c73477f4928c44de5a5394c26c6e0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.131Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2e65ed31bdacde5ef0587620: start","job_status":"start","queue_duration_s":1.50364,"scheduling_latency_s":1.503668} gitlab # [ 291.864834] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2e65ed31bdacde5ef0587620","created_at":"2026-08-11T10:00:02.125Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b74c73477f4928c44de5a5394c26c6e0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.131Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2e65ed31bdacde5ef0587620: done: 0.033682 sec","job_status":"done","queue_duration_s":1.50364,"scheduling_latency_s":1.503668,"redis_calls":10,"redis_duration_s":0.004293,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003024,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0083777,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033682,"completed_at":"2026-08-11T10:00:03.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004487,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 291.909048] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"afe8a921888ecdecc8d6acb2","created_at":"2026-08-11T10:00:02.137Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd9de75858c58dc6f79dee6f7636c3d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.142Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-afe8a921888ecdecc8d6acb2: start","job_status":"start","queue_duration_s":1.528646,"scheduling_latency_s":1.528667} gitlab # [ 291.924040] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.680Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 291.927401] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"afe8a921888ecdecc8d6acb2","created_at":"2026-08-11T10:00:02.137Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd9de75858c58dc6f79dee6f7636c3d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.142Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-afe8a921888ecdecc8d6acb2: done: 0.018005 sec","job_status":"done","queue_duration_s":1.528646,"scheduling_latency_s":1.528667,"redis_calls":7,"redis_duration_s":0.001767,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018005,"completed_at":"2026-08-11T10:00:03.688Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.968773] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.690Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"85319309a45c6bbc010a94dd","created_at":"2026-08-11T10:00:02.147Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48f3110dd62e7325208b96e895a98163","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.172Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-85319309a45c6bbc010a94dd: start","job_status":"start","queue_duration_s":1.518124,"scheduling_latency_s":1.518142} gitlab # [ 291.981954] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.743Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"85319309a45c6bbc010a94dd","created_at":"2026-08-11T10:00:02.147Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48f3110dd62e7325208b96e895a98163","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.172Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-85319309a45c6bbc010a94dd: done: 0.0525 sec","job_status":"done","queue_duration_s":1.518124,"scheduling_latency_s":1.518142,"redis_calls":12,"redis_duration_s":0.00414,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000907,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000704,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056338,"duration_s":0.0525,"completed_at":"2026-08-11T10:00:03.742Z","load_balancing_strategy":"primary","db_duration_s":0.000915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.023748] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d008f7b228a768aad448753e","created_at":"2026-08-11T10:00:02.225Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8188dedce218f6fa3b1057283f2f6640","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.229Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d008f7b228a768aad448753e: start","job_status":"start","queue_duration_s":1.51583,"scheduling_latency_s":1.515863} gitlab # [ 292.091858] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d008f7b228a768aad448753e","created_at":"2026-08-11T10:00:02.225Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8188dedce218f6fa3b1057283f2f6640","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.229Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d008f7b228a768aad448753e: done: 0.247029 sec","job_status":"done","queue_duration_s":1.51583,"scheduling_latency_s":1.515863,"redis_calls":11,"redis_duration_s":0.003414,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.211323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00084016,"exclusive_lock_hold_duration_s":0.21571696,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.247029,"completed_at":"2026-08-11T10:00:03.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.152333] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:03.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"3c63980febc999eeab75af17","created_at":"2026-08-11T10:00:02.290Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68ae5f30fedfa0d894e49ab5e1693872","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.297Z","job_size_bytes":101,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-3c63980febc999eeab75af17: start","job_status":"start","queue_duration_s":1.696819,"scheduling_latency_s":1.696836} gitlab # [ 292.178898] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"3c63980febc999eeab75af17","created_at":"2026-08-11T10:00:02.290Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68ae5f30fedfa0d894e49ab5e1693872","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.297Z","job_size_bytes":101,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-3c63980febc999eeab75af17: done: 0.08536 sec","job_status":"done","queue_duration_s":1.696819,"scheduling_latency_s":1.696836,"redis_calls":10,"redis_duration_s":0.002635,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047854,"duration_s":0.08536,"completed_at":"2026-08-11T10:00:04.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.230526] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"1f386d051639e4d0402a760d","created_at":"2026-08-11T10:00:02.310Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0500a11376da9f0489e4089a920c081","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.327Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-1f386d051639e4d0402a760d: start","job_status":"start","queue_duration_s":1.754509,"scheduling_latency_s":1.754528} gitlab # [ 292.245177] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"1f386d051639e4d0402a760d","created_at":"2026-08-11T10:00:02.310Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0500a11376da9f0489e4089a920c081","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.327Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-1f386d051639e4d0402a760d: done: 0.022057 sec","job_status":"done","queue_duration_s":1.754509,"scheduling_latency_s":1.754528,"redis_calls":11,"redis_duration_s":0.002678,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000618,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000716,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033524,"duration_s":0.022057,"completed_at":"2026-08-11T10:00:04.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.287433] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"61ae62b9b45ff5d83b770dd0","created_at":"2026-08-11T10:00:02.413Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dae9b9d3ce7d61a69f501712fd4060d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.429Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-61ae62b9b45ff5d83b770dd0: start","job_status":"start","queue_duration_s":1.675072,"scheduling_latency_s":1.675088} gitlab # [ 292.301778] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"61ae62b9b45ff5d83b770dd0","created_at":"2026-08-11T10:00:02.413Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dae9b9d3ce7d61a69f501712fd4060d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.429Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-61ae62b9b45ff5d83b770dd0: done: 0.028734 sec","job_status":"done","queue_duration_s":1.675072,"scheduling_latency_s":1.675088,"redis_calls":11,"redis_duration_s":0.0032649999999999997,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001942,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069434,"duration_s":0.028734,"completed_at":"2026-08-11T10:00:04.133Z","load_balancing_strategy":"primary","db_duration_s":0.005446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.342411] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"daff96c2de2f46fd5464f5e7","created_at":"2026-08-11T10:00:02.454Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.468Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-daff96c2de2f46fd5464f5e7: start","job_status":"start","queue_duration_s":1.666768,"scheduling_latency_s":1.666783} gitlab # [ 292.355815] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"daff96c2de2f46fd5464f5e7","created_at":"2026-08-11T10:00:02.454Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.468Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-daff96c2de2f46fd5464f5e7: done: 0.093843 sec","job_status":"done","queue_duration_s":1.666768,"scheduling_latency_s":1.666783,"redis_calls":60,"redis_duration_s":0.014281,"redis_read_bytes":109,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000695,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01293,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093843,"completed_at":"2026-08-11T10:00:04.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.396868] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"788542fbcef0b771b42e272b","created_at":"2026-08-11T10:00:02.489Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bac93773e49d87592459ea6228beb35","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.498Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-788542fbcef0b771b42e272b: start","job_status":"start","queue_duration_s":1.732153,"scheduling_latency_s":1.732169} gitlab # [ 292.410906] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"788542fbcef0b771b42e272b","created_at":"2026-08-11T10:00:02.489Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bac93773e49d87592459ea6228beb35","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.498Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-788542fbcef0b771b42e272b: done: 0.016646 sec","job_status":"done","queue_duration_s":1.732153,"scheduling_latency_s":1.732169,"redis_calls":7,"redis_duration_s":0.001794,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016646,"completed_at":"2026-08-11T10:00:04.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.450879] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"266bc81293e5e8df9ad35a32","created_at":"2026-08-11T10:00:02.540Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2d3216b81882211237eb4723ac666d9","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.562Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-266bc81293e5e8df9ad35a32: start","job_status":"start","queue_duration_s":1.686235,"scheduling_latency_s":1.686251} gitlab # [ 292.464204] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"266bc81293e5e8df9ad35a32","created_at":"2026-08-11T10:00:02.540Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2d3216b81882211237eb4723ac666d9","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.562Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-266bc81293e5e8df9ad35a32: done: 0.030547 sec","job_status":"done","queue_duration_s":1.686235,"scheduling_latency_s":1.686251,"redis_calls":12,"redis_duration_s":0.003102,"redis_read_bytes":11,"redis_write_bytes":1420,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00127,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":638,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003161,"duration_s":0.030547,"completed_at":"2026-08-11T10:00:04.279Z","load_balancing_strategy":"primary","db_duration_s":0.00558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.505968] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"4a44999c5d1db438f6678a14","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-4a44999c5d1db438f6678a14: start","job_status":"start","queue_duration_s":1.662919,"scheduling_latency_s":1.662935} gitlab # [ 292.518508] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"4a44999c5d1db438f6678a14","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-4a44999c5d1db438f6678a14: done: 0.051023 sec","job_status":"done","queue_duration_s":1.662919,"scheduling_latency_s":1.662935,"redis_calls":18,"redis_duration_s":0.005238,"redis_read_bytes":39,"redis_write_bytes":2116,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":471,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003522,"redis_shared_state_read_bytes":34,"redis_shared_state_write_bytes":1324,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036742,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.051023,"completed_at":"2026-08-11T10:00:04.331Z","load_balancing_strategy":"primary","db_duration_s":0.020448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.562026] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"8d7f26b4cca604551e19a7bc","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-8d7f26b4cca604551e19a7bc: start","job_status":"start","queue_duration_s":1.71572,"scheduling_latency_s":1.715735} gitlab # [ 292.574565] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"8d7f26b4cca604551e19a7bc","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-8d7f26b4cca604551e19a7bc: done: 0.024817 sec","job_status":"done","queue_duration_s":1.71572,"scheduling_latency_s":1.715735,"redis_calls":15,"redis_duration_s":0.003378,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002342,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":0,"duration_s":0.024817,"completed_at":"2026-08-11T10:00:04.358Z","load_balancing_strategy":"primary","db_duration_s":0.004418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.616195] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"c60963719928e2648f5ad1ee","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-c60963719928e2648f5ad1ee: start","job_status":"start","queue_duration_s":1.741905,"scheduling_latency_s":1.74192} gitlab # [ 292.628271] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"c60963719928e2648f5ad1ee","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-c60963719928e2648f5ad1ee: done: 0.027265 sec","job_status":"done","queue_duration_s":1.741905,"scheduling_latency_s":1.74192,"redis_calls":15,"redis_duration_s":0.002532,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001666,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":2,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":2,"duration_s":0.027265,"completed_at":"2026-08-11T10:00:04.387Z","load_balancing_strategy":"primary","db_duration_s":0.006946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.670303] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"3679a38915a85a55b919612c","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-3679a38915a85a55b919612c: start","job_status":"start","queue_duration_s":1.770545,"scheduling_latency_s":1.770562} gitlab # [ 292.682685] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"3679a38915a85a55b919612c","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-3679a38915a85a55b919612c: done: 0.029961 sec","job_status":"done","queue_duration_s":1.770545,"scheduling_latency_s":1.770562,"redis_calls":15,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":3,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":3,"duration_s":0.029961,"completed_at":"2026-08-11T10:00:04.418Z","load_balancing_strategy":"primary","db_duration_s":0.009145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.725712] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"e0ae85fa31482d36ec93b7c5","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-e0ae85fa31482d36ec93b7c5: start","job_status":"start","queue_duration_s":1.801613,"scheduling_latency_s":1.801631} gitlab # [ 292.738233] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"e0ae85fa31482d36ec93b7c5","created_at":"2026-08-11T10:00:02.547Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-2f37547f4a384dd7","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"125dfe89ecace5e89d7d581edee46124","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.617Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-e0ae85fa31482d36ec93b7c5: done: 0.024955 sec","job_status":"done","queue_duration_s":1.801613,"scheduling_latency_s":1.801631,"redis_calls":15,"redis_duration_s":0.0023049999999999998,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":2,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":2,"duration_s":0.024955,"completed_at":"2026-08-11T10:00:04.444Z","load_balancing_strategy":"primary","db_duration_s":0.00434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.779993] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"5ec4b7a245b8864ecab25f68","created_at":"2026-08-11T10:00:02.593Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64a02e306986c68228747106a6c427b1","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.622Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-5ec4b7a245b8864ecab25f68: start","job_status":"start","queue_duration_s":1.823181,"scheduling_latency_s":1.823199} gitlab # [ 292.793239] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.504Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"5ec4b7a245b8864ecab25f68","created_at":"2026-08-11T10:00:02.593Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64a02e306986c68228747106a6c427b1","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.622Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-5ec4b7a245b8864ecab25f68: done: 0.058412 sec","job_status":"done","queue_duration_s":1.823181,"scheduling_latency_s":1.823199,"redis_calls":10,"redis_duration_s":0.001341,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024604,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.0039371},"duration_s":0.058412,"completed_at":"2026-08-11T10:00:04.504Z","load_balancing_strategy":"primary","db_duration_s":0.026828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.835887] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"e65cd6d707840acf8458a027","created_at":"2026-08-11T10:00:02.650Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95963e1b7c06c3f7d17c49ca736a97b","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.670Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-e65cd6d707840acf8458a027: start","job_status":"start","queue_duration_s":1.834747,"scheduling_latency_s":1.834764} gitlab # [ 292.849218] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"e65cd6d707840acf8458a027","created_at":"2026-08-11T10:00:02.650Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95963e1b7c06c3f7d17c49ca736a97b","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.670Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-e65cd6d707840acf8458a027: done: 0.033703 sec","job_status":"done","queue_duration_s":1.834747,"scheduling_latency_s":1.834764,"redis_calls":10,"redis_duration_s":0.001495,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002637,"duration_s":0.033703,"completed_at":"2026-08-11T10:00:04.538Z","load_balancing_strategy":"primary","db_duration_s":0.007788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.890463] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fb72788f80b6f4ceefb7c6a5","created_at":"2026-08-11T10:00:02.715Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55e7378c54ddc5d42c30417fe3b9cb74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.724Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fb72788f80b6f4ceefb7c6a5: start","job_status":"start","queue_duration_s":1.815799,"scheduling_latency_s":1.815817} gitlab # [ 292.904934] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.548Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 292.909548] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fb72788f80b6f4ceefb7c6a5","created_at":"2026-08-11T10:00:02.715Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55e7378c54ddc5d42c30417fe3b9cb74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.724Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fb72788f80b6f4ceefb7c6a5: done: 0.013697 sec","job_status":"done","queue_duration_s":1.815799,"scheduling_latency_s":1.815817,"redis_calls":7,"redis_duration_s":0.000978,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013697,"completed_at":"2026-08-11T10:00:04.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.949838] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9ecb09c80d861920b5021ac2","created_at":"2026-08-11T10:00:02.748Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c63a990fccc93d0b0d5c20d22ddf28c7","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.783Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9ecb09c80d861920b5021ac2: start","job_status":"start","queue_duration_s":1.771649,"scheduling_latency_s":1.771666} gitlab # [ 292.964064] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9ecb09c80d861920b5021ac2","created_at":"2026-08-11T10:00:02.748Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c63a990fccc93d0b0d5c20d22ddf28c7","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.783Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9ecb09c80d861920b5021ac2: done: 0.027498 sec","job_status":"done","queue_duration_s":1.771649,"scheduling_latency_s":1.771666,"redis_calls":10,"redis_duration_s":0.001333,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025584,"duration_s":0.027498,"completed_at":"2026-08-11T10:00:04.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.006151] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"51068cedba92dc0ae87d7c82","created_at":"2026-08-11T10:00:02.799Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"336cf2ca79522ee02b5443bbac76e8a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.835Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-51068cedba92dc0ae87d7c82: start","job_status":"start","queue_duration_s":1.74785,"scheduling_latency_s":1.747866} gitlab # [ 293.020552] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"51068cedba92dc0ae87d7c82","created_at":"2026-08-11T10:00:02.799Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"336cf2ca79522ee02b5443bbac76e8a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.835Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-51068cedba92dc0ae87d7c82: done: 0.018381 sec","job_status":"done","queue_duration_s":1.74785,"scheduling_latency_s":1.747866,"redis_calls":12,"redis_duration_s":0.001513,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021436,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.018381,"completed_at":"2026-08-11T10:00:04.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.065493] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.603Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bf49db9e2cc2c7f3f122d650","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bf49db9e2cc2c7f3f122d650: start","job_status":"start","queue_duration_s":1.762303,"scheduling_latency_s":1.762319} gitlab # [ 293.077821] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.615Z","message":"No existing merge request to be cleaned up."} gitlab # [ 293.079454] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.623Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bf49db9e2cc2c7f3f122d650","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bf49db9e2cc2c7f3f122d650: done: 0.020338 sec","job_status":"done","queue_duration_s":1.762303,"scheduling_latency_s":1.762319,"redis_calls":10,"redis_duration_s":0.001273,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020338,"completed_at":"2026-08-11T10:00:04.623Z","load_balancing_strategy":"primary","db_duration_s":0.003692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.118857] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.624Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cf34b09b74f9b192b8ed6b0e","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cf34b09b74f9b192b8ed6b0e: start","job_status":"start","queue_duration_s":1.783922,"scheduling_latency_s":1.783939} gitlab # [ 293.131298] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.635Z","message":"No existing merge request to be cleaned up."} gitlab # [ 293.133068] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.643Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cf34b09b74f9b192b8ed6b0e","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cf34b09b74f9b192b8ed6b0e: done: 0.018924 sec","job_status":"done","queue_duration_s":1.783922,"scheduling_latency_s":1.783939,"redis_calls":10,"redis_duration_s":0.001518,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018924,"completed_at":"2026-08-11T10:00:04.643Z","load_balancing_strategy":"primary","db_duration_s":0.002297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.171434] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.644Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d65a3aec440ce0e386baadcf","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d65a3aec440ce0e386baadcf: start","job_status":"start","queue_duration_s":1.803917,"scheduling_latency_s":1.803934} gitlab # [ 293.183600] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.655Z","message":"No existing merge request to be cleaned up."} gitlab # [ 293.185350] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.663Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d65a3aec440ce0e386baadcf","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d65a3aec440ce0e386baadcf: done: 0.018373 sec","job_status":"done","queue_duration_s":1.803917,"scheduling_latency_s":1.803934,"redis_calls":10,"redis_duration_s":0.001255,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018373,"completed_at":"2026-08-11T10:00:04.663Z","load_balancing_strategy":"primary","db_duration_s":0.002111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.223640] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.664Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"49bfda769c2153ae16c20f7d","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-49bfda769c2153ae16c20f7d: start","job_status":"start","queue_duration_s":1.823579,"scheduling_latency_s":1.823597} gitlab # [ 293.236125] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.674Z","message":"No existing merge request to be cleaned up."} gitlab # [ 293.237744] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.683Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"49bfda769c2153ae16c20f7d","created_at":"2026-08-11T10:00:02.794Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-5822625fd25c4e2b","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c84c94024ff49f4740ea764febb94875","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.840Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-49bfda769c2153ae16c20f7d: done: 0.018854 sec","job_status":"done","queue_duration_s":1.823579,"scheduling_latency_s":1.823597,"redis_calls":10,"redis_duration_s":0.001269,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018854,"completed_at":"2026-08-11T10:00:04.683Z","load_balancing_strategy":"primary","db_duration_s":0.002229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.275719] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"58358dd9a01cc5b891d8f7c3","created_at":"2026-08-11T10:00:02.856Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0366f6d9d88b4df94d7f7d42a096ae88","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.867Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-58358dd9a01cc5b891d8f7c3: start","job_status":"start","queue_duration_s":1.816755,"scheduling_latency_s":1.816772} gitlab # [ 293.290567] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"58358dd9a01cc5b891d8f7c3","created_at":"2026-08-11T10:00:02.856Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0366f6d9d88b4df94d7f7d42a096ae88","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.867Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-58358dd9a01cc5b891d8f7c3: done: 0.013473 sec","job_status":"done","queue_duration_s":1.816755,"scheduling_latency_s":1.816772,"redis_calls":8,"redis_duration_s":0.001023,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000121,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013473,"completed_at":"2026-08-11T10:00:04.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.333823] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"50f0f53b114ef4450ca8c91c","created_at":"2026-08-11T10:00:02.888Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06aa507da68eddb264a06974f3c6640b","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.938Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-50f0f53b114ef4450ca8c91c: start","job_status":"start","queue_duration_s":1.760478,"scheduling_latency_s":1.760494} gitlab # [ 293.347306] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"50f0f53b114ef4450ca8c91c","created_at":"2026-08-11T10:00:02.888Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06aa507da68eddb264a06974f3c6640b","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.938Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-50f0f53b114ef4450ca8c91c: done: 0.021096 sec","job_status":"done","queue_duration_s":1.760478,"scheduling_latency_s":1.760494,"redis_calls":10,"redis_duration_s":0.001269,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002221,"duration_s":0.021096,"completed_at":"2026-08-11T10:00:04.719Z","load_balancing_strategy":"primary","db_duration_s":0.00063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.389463] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e2002ffa841a1f88a5e7b268","created_at":"2026-08-11T10:00:02.946Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a669b089861b83a738db0ac2442e53ff","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.959Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e2002ffa841a1f88a5e7b268: start","job_status":"start","queue_duration_s":1.761069,"scheduling_latency_s":1.761086} gitlab # [ 293.404340] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e2002ffa841a1f88a5e7b268","created_at":"2026-08-11T10:00:02.946Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a669b089861b83a738db0ac2442e53ff","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:02.959Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e2002ffa841a1f88a5e7b268: done: 0.024622 sec","job_status":"done","queue_duration_s":1.761069,"scheduling_latency_s":1.761086,"redis_calls":12,"redis_duration_s":0.0017519999999999999,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046192,"exclusive_lock_hold_duration_s":0.00653558,"duration_s":0.024622,"completed_at":"2026-08-11T10:00:04.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.446599] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d78d04a62276673d35a78043","created_at":"2026-08-11T10:00:02.966Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c3afcba2731e675c29846f88ed180cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:00:02.973Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d78d04a62276673d35a78043: start","job_status":"start","queue_duration_s":1.773365,"scheduling_latency_s":1.773382} gitlab # [ 293.459994] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.753Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 293.463119] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d78d04a62276673d35a78043","created_at":"2026-08-11T10:00:02.966Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c3afcba2731e675c29846f88ed180cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:00:02.973Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d78d04a62276673d35a78043: done: 0.012402 sec","job_status":"done","queue_duration_s":1.773365,"scheduling_latency_s":1.773382,"redis_calls":7,"redis_duration_s":0.0009029999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012402,"completed_at":"2026-08-11T10:00:04.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.502769] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ad94768aba425c89bca442de","created_at":"2026-08-11T10:00:03.019Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f5cf57e69fe5c117314ce231ada8066","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.028Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ad94768aba425c89bca442de: start","job_status":"start","queue_duration_s":1.731978,"scheduling_latency_s":1.731993} gitlab # [ 293.517515] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ad94768aba425c89bca442de","created_at":"2026-08-11T10:00:03.019Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f5cf57e69fe5c117314ce231ada8066","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.028Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ad94768aba425c89bca442de: done: 0.029597 sec","job_status":"done","queue_duration_s":1.731978,"scheduling_latency_s":1.731993,"redis_calls":7,"redis_duration_s":0.000931,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.029597,"completed_at":"2026-08-11T10:00:04.789Z","load_balancing_strategy":"primary","db_duration_s":0.015932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.558380] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"b49f79202cf8c3e1705af0e9","created_at":"2026-08-11T10:00:03.057Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95ce8c7cc0eba4fb715114a2c1aad458","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.080Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-b49f79202cf8c3e1705af0e9: start","job_status":"start","queue_duration_s":1.709878,"scheduling_latency_s":1.709894} gitlab # [ 293.571872] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"b49f79202cf8c3e1705af0e9","created_at":"2026-08-11T10:00:03.057Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95ce8c7cc0eba4fb715114a2c1aad458","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.080Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-b49f79202cf8c3e1705af0e9: done: 0.029975 sec","job_status":"done","queue_duration_s":1.709878,"scheduling_latency_s":1.709894,"redis_calls":12,"redis_duration_s":0.001549,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00044418,"exclusive_lock_hold_duration_s":0.01195788,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.029975,"completed_at":"2026-08-11T10:00:04.820Z","load_balancing_strategy":"primary","db_duration_s":0.007083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.614428] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fc868286c990fd673d7d20df","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fc868286c990fd673d7d20df: start","job_status":"start","queue_duration_s":1.709823,"scheduling_latency_s":1.70984} gitlab # [ 293.627619] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fc868286c990fd673d7d20df","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fc868286c990fd673d7d20df: done: 0.050348 sec","job_status":"done","queue_duration_s":1.709823,"scheduling_latency_s":1.70984,"redis_calls":16,"redis_duration_s":0.002578,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001541,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024612,"duration_s":0.050348,"completed_at":"2026-08-11T10:00:04.872Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.669813] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e6c4bde798ecbb1e12000952","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e6c4bde798ecbb1e12000952: start","job_status":"start","queue_duration_s":1.761351,"scheduling_latency_s":1.761394} gitlab # [ 293.683254] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e6c4bde798ecbb1e12000952","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e6c4bde798ecbb1e12000952: done: 0.017869 sec","job_status":"done","queue_duration_s":1.761351,"scheduling_latency_s":1.761394,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017869,"completed_at":"2026-08-11T10:00:04.891Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.724382] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"55dafae44ade51c2edc36d0b","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-55dafae44ade51c2edc36d0b: start","job_status":"start","queue_duration_s":1.780386,"scheduling_latency_s":1.780404} gitlab # [ 293.737786] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"55dafae44ade51c2edc36d0b","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-55dafae44ade51c2edc36d0b: done: 0.016638 sec","job_status":"done","queue_duration_s":1.780386,"scheduling_latency_s":1.780404,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016638,"completed_at":"2026-08-11T10:00:04.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.777907] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7eb0a242ae7cdb6512242eec","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7eb0a242ae7cdb6512242eec: start","job_status":"start","queue_duration_s":1.798205,"scheduling_latency_s":1.798222} gitlab # [ 293.791318] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7eb0a242ae7cdb6512242eec","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7eb0a242ae7cdb6512242eec: done: 0.016385 sec","job_status":"done","queue_duration_s":1.798205,"scheduling_latency_s":1.798222,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016385,"completed_at":"2026-08-11T10:00:04.926Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.831579] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"776e19955a3f592aaaccdc56","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-776e19955a3f592aaaccdc56: start","job_status":"start","queue_duration_s":1.81567,"scheduling_latency_s":1.815685} gitlab # [ 293.845317] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"776e19955a3f592aaaccdc56","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-776e19955a3f592aaaccdc56: done: 0.016593 sec","job_status":"done","queue_duration_s":1.81567,"scheduling_latency_s":1.815685,"redis_calls":13,"redis_duration_s":0.00168,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016593,"completed_at":"2026-08-11T10:00:04.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.885051] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dc2aaa5108952c1a45ce7f8a","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dc2aaa5108952c1a45ce7f8a: start","job_status":"start","queue_duration_s":1.833586,"scheduling_latency_s":1.833603} gitlab # [ 293.898837] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dc2aaa5108952c1a45ce7f8a","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dc2aaa5108952c1a45ce7f8a: done: 0.01581 sec","job_status":"done","queue_duration_s":1.833586,"scheduling_latency_s":1.833603,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01581,"completed_at":"2026-08-11T10:00:04.961Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.939933] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9a4a1ded2768c522791fe2b7","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9a4a1ded2768c522791fe2b7: start","job_status":"start","queue_duration_s":1.850459,"scheduling_latency_s":1.850475} gitlab # [ 293.953360] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9a4a1ded2768c522791fe2b7","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9a4a1ded2768c522791fe2b7: done: 0.015246 sec","job_status":"done","queue_duration_s":1.850459,"scheduling_latency_s":1.850475,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015246,"completed_at":"2026-08-11T10:00:04.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.993090] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"71f8e6e93505a98303057d37","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-71f8e6e93505a98303057d37: start","job_status":"start","queue_duration_s":1.866759,"scheduling_latency_s":1.866775} gitlab # [ 294.006649] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"71f8e6e93505a98303057d37","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-71f8e6e93505a98303057d37: done: 0.015703 sec","job_status":"done","queue_duration_s":1.866759,"scheduling_latency_s":1.866775,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015703,"completed_at":"2026-08-11T10:00:04.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.047168] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:04.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"55e59d925ccff5ee8151d4fe","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-55e59d925ccff5ee8151d4fe: start","job_status":"start","queue_duration_s":1.883527,"scheduling_latency_s":1.883543} gitlab # [ 294.060735] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"55e59d925ccff5ee8151d4fe","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-55e59d925ccff5ee8151d4fe: done: 0.015305 sec","job_status":"done","queue_duration_s":1.883527,"scheduling_latency_s":1.883543,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015305,"completed_at":"2026-08-11T10:00:05.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.100435] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"597c953d77d95d3f0418739f","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-597c953d77d95d3f0418739f: start","job_status":"start","queue_duration_s":1.901117,"scheduling_latency_s":1.901134} gitlab # [ 294.113473] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"597c953d77d95d3f0418739f","created_at":"2026-08-11T10:00:02.968Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-f4f135dc9a9241ca","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"0906b911de03d45491fe858a95ccedbd","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.111Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-597c953d77d95d3f0418739f: done: 0.015536 sec","job_status":"done","queue_duration_s":1.901117,"scheduling_latency_s":1.901134,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015536,"completed_at":"2026-08-11T10:00:05.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.153847] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ad5323233aba6bebf36a352e","created_at":"2026-08-11T10:00:03.105Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2f0652e5097475d86e83a7a9ae518f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.115Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ad5323233aba6bebf36a352e: start","job_status":"start","queue_duration_s":1.914282,"scheduling_latency_s":1.914299} gitlab # [ 294.167694] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ad5323233aba6bebf36a352e","created_at":"2026-08-11T10:00:03.105Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca2f0652e5097475d86e83a7a9ae518f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.115Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ad5323233aba6bebf36a352e: done: 0.308236 sec","job_status":"done","queue_duration_s":1.914282,"scheduling_latency_s":1.914299,"redis_calls":562,"redis_duration_s":0.053203,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.05239,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.287984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.308236,"completed_at":"2026-08-11T10:00:05.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.207993] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"fdfa21af02d22915baf6a5f2","created_at":"2026-08-11T10:00:03.145Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da6d7601aef39f1e13d7a92caea1d0c7","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.162Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-fdfa21af02d22915baf6a5f2: start","job_status":"start","queue_duration_s":2.176485,"scheduling_latency_s":2.176504} gitlab # [ 294.221284] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"fdfa21af02d22915baf6a5f2","created_at":"2026-08-11T10:00:03.145Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da6d7601aef39f1e13d7a92caea1d0c7","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.162Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-fdfa21af02d22915baf6a5f2: done: 0.029264 sec","job_status":"done","queue_duration_s":2.176485,"scheduling_latency_s":2.176504,"redis_calls":10,"redis_duration_s":0.001273,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002282,"duration_s":0.029264,"completed_at":"2026-08-11T10:00:05.368Z","load_balancing_strategy":"primary","db_duration_s":0.006821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.262156] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2f6bca87fe2c470b019e9e98","created_at":"2026-08-11T10:00:03.168Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98add1c2076a9730dabed8be50b1c88c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.176Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2f6bca87fe2c470b019e9e98: start","job_status":"start","queue_duration_s":2.19308,"scheduling_latency_s":2.193096} gitlab # [ 294.276826] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2f6bca87fe2c470b019e9e98","created_at":"2026-08-11T10:00:03.168Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98add1c2076a9730dabed8be50b1c88c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.176Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2f6bca87fe2c470b019e9e98: done: 0.043399 sec","job_status":"done","queue_duration_s":2.19308,"scheduling_latency_s":2.193096,"redis_calls":9,"redis_duration_s":0.001412,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053566,"exclusive_lock_hold_duration_s":0.02075744,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.043399,"completed_at":"2026-08-11T10:00:05.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.319694] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"095542779c47b04c633a64f7","created_at":"2026-08-11T10:00:03.184Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"433ecfe012cf8a973b4cadc40e48e575","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.199Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-095542779c47b04c633a64f7: start","job_status":"start","queue_duration_s":2.214657,"scheduling_latency_s":2.214675} gitlab # [ 294.334988] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.596Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"095542779c47b04c633a64f7","created_at":"2026-08-11T10:00:03.184Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"433ecfe012cf8a973b4cadc40e48e575","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.199Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-095542779c47b04c633a64f7: done: 0.182538 sec","job_status":"done","queue_duration_s":2.214657,"scheduling_latency_s":2.214675,"redis_calls":12,"redis_duration_s":0.002483,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047772,"exclusive_lock_hold_duration_s":0.16366442,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.182538,"completed_at":"2026-08-11T10:00:05.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019333,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 294.378800] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"e14ee006511fcac49397dbfb","created_at":"2026-08-11T10:00:03.210Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"151252a107ff887392c00480e7f06d02","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.222Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-e14ee006511fcac49397dbfb: start","job_status":"start","queue_duration_s":2.376258,"scheduling_latency_s":2.376274} gitlab # [ 294.393584] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"e14ee006511fcac49397dbfb","created_at":"2026-08-11T10:00:03.210Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"151252a107ff887392c00480e7f06d02","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.222Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-e14ee006511fcac49397dbfb: done: 0.039372 sec","job_status":"done","queue_duration_s":2.376258,"scheduling_latency_s":2.376274,"redis_calls":13,"redis_duration_s":0.0033309999999999998,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053702,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.039372,"completed_at":"2026-08-11T10:00:05.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.437998] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7c06c6c18796e2a535e72c62","created_at":"2026-08-11T10:00:03.226Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38a54e90fd2e15958e8ab3ed8b690cfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:00:03.232Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7c06c6c18796e2a535e72c62: start","job_status":"start","queue_duration_s":2.408774,"scheduling_latency_s":2.408814} gitlab # [ 294.451244] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7c06c6c18796e2a535e72c62","created_at":"2026-08-11T10:00:03.226Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"38a54e90fd2e15958e8ab3ed8b690cfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:00:03.232Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7c06c6c18796e2a535e72c62: done: 0.047883 sec","job_status":"done","queue_duration_s":2.408774,"scheduling_latency_s":2.408814,"redis_calls":7,"redis_duration_s":0.002627,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047883,"completed_at":"2026-08-11T10:00:05.688Z","load_balancing_strategy":"primary","db_duration_s":0.00205,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.490236] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"af3b96f7dc7db898bfe414af","created_at":"2026-08-11T10:00:03.239Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a123d708e470203a790f5c37a99e39d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.244Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-af3b96f7dc7db898bfe414af: start","job_status":"start","queue_duration_s":2.446719,"scheduling_latency_s":2.446753} gitlab # [ 294.504630] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"af3b96f7dc7db898bfe414af","created_at":"2026-08-11T10:00:03.239Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a123d708e470203a790f5c37a99e39d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.244Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-af3b96f7dc7db898bfe414af: done: 0.030479 sec","job_status":"done","queue_duration_s":2.446719,"scheduling_latency_s":2.446753,"redis_calls":9,"redis_duration_s":0.0030559999999999997,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008613,"exclusive_lock_hold_duration_s":0.00479104,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.030479,"completed_at":"2026-08-11T10:00:05.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.546855] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9eaf67e771a53b08ade32e07","created_at":"2026-08-11T10:00:03.251Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56dfda059f6c0c64151defb864e98ec0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.256Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9eaf67e771a53b08ade32e07: start","job_status":"start","queue_duration_s":2.46779,"scheduling_latency_s":2.467816} gitlab # [ 294.561483] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9eaf67e771a53b08ade32e07","created_at":"2026-08-11T10:00:03.251Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56dfda059f6c0c64151defb864e98ec0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.256Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9eaf67e771a53b08ade32e07: done: 0.061543 sec","job_status":"done","queue_duration_s":2.46779,"scheduling_latency_s":2.467816,"redis_calls":9,"redis_duration_s":0.003594,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00133182,"exclusive_lock_hold_duration_s":0.036089,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.061543,"completed_at":"2026-08-11T10:00:05.785Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.604796] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"829ee5ca10749925a06bbb09","created_at":"2026-08-11T10:00:03.271Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a1cede554f8bf3476df8b95b3826ed6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:00:03.275Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-829ee5ca10749925a06bbb09: start","job_status":"start","queue_duration_s":2.512499,"scheduling_latency_s":2.51253} gitlab # [ 294.618108] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.800Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 294.621838] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"829ee5ca10749925a06bbb09","created_at":"2026-08-11T10:00:03.271Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a1cede554f8bf3476df8b95b3826ed6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:00:03.275Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-829ee5ca10749925a06bbb09: done: 0.020099 sec","job_status":"done","queue_duration_s":2.512499,"scheduling_latency_s":2.51253,"redis_calls":7,"redis_duration_s":0.001978,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020099,"completed_at":"2026-08-11T10:00:05.808Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.661247] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"617e40be995e0b6cfd85d46d","created_at":"2026-08-11T10:00:03.279Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42fdbbedf4121474bc9aad09adc2c1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.287Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-617e40be995e0b6cfd85d46d: start","job_status":"start","queue_duration_s":2.522311,"scheduling_latency_s":2.522337} gitlab # [ 294.675888] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"617e40be995e0b6cfd85d46d","created_at":"2026-08-11T10:00:03.279Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42fdbbedf4121474bc9aad09adc2c1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.287Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-617e40be995e0b6cfd85d46d: done: 0.046398 sec","job_status":"done","queue_duration_s":2.522311,"scheduling_latency_s":2.522337,"redis_calls":20,"redis_duration_s":0.005928999999999999,"redis_read_bytes":25,"redis_write_bytes":4317,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001985,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.001181,"redis_queues_read_bytes":8,"redis_queues_write_bytes":2022,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040644,"duration_s":0.046398,"completed_at":"2026-08-11T10:00:05.856Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.720330] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"db692e93912244f7ebf5ef4b","created_at":"2026-08-11T10:00:03.291Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"723cf830b1ee89cb627eb4f751fb6d4a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.310Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-db692e93912244f7ebf5ef4b: start","job_status":"start","queue_duration_s":2.547624,"scheduling_latency_s":2.547646} gitlab # [ 294.733733] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"db692e93912244f7ebf5ef4b","created_at":"2026-08-11T10:00:03.291Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"723cf830b1ee89cb627eb4f751fb6d4a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.310Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-db692e93912244f7ebf5ef4b: done: 0.026596 sec","job_status":"done","queue_duration_s":2.547624,"scheduling_latency_s":2.547646,"redis_calls":10,"redis_duration_s":0.003082,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000683,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041978,"duration_s":0.026596,"completed_at":"2026-08-11T10:00:05.884Z","load_balancing_strategy":"primary","db_duration_s":0.001609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.776262] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"cafa133ac290af606ff03a6c","created_at":"2026-08-11T10:00:03.321Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3ed7164b77cfced85a76d01fc5ab868","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.329Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-cafa133ac290af606ff03a6c: start","job_status":"start","queue_duration_s":2.557663,"scheduling_latency_s":2.557683} gitlab # [ 294.790822] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"cafa133ac290af606ff03a6c","created_at":"2026-08-11T10:00:03.321Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3ed7164b77cfced85a76d01fc5ab868","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.329Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-cafa133ac290af606ff03a6c: done: 0.015064 sec","job_status":"done","queue_duration_s":2.557663,"scheduling_latency_s":2.557683,"redis_calls":7,"redis_duration_s":0.001764,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015064,"completed_at":"2026-08-11T10:00:05.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.831810] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"4fc0124b077e99d3d735e2ce","created_at":"2026-08-11T10:00:03.334Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f2198539637c40f71296ba2ea36e82f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.352Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-4fc0124b077e99d3d735e2ce: start","job_status":"start","queue_duration_s":2.550353,"scheduling_latency_s":2.550371} gitlab # [ 294.846366] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"4fc0124b077e99d3d735e2ce","created_at":"2026-08-11T10:00:03.334Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f2198539637c40f71296ba2ea36e82f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.352Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-4fc0124b077e99d3d735e2ce: done: 0.0208 sec","job_status":"done","queue_duration_s":2.550353,"scheduling_latency_s":2.550371,"redis_calls":11,"redis_duration_s":0.0026839999999999998,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001402,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000241,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031934,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.0208,"completed_at":"2026-08-11T10:00:05.924Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.890587] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"592d335067f7e8cdfe1767d1","created_at":"2026-08-11T10:00:03.357Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9305c23889db767b0f672a2058c9a00","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.396Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-592d335067f7e8cdfe1767d1: start","job_status":"start","queue_duration_s":2.529603,"scheduling_latency_s":2.529619} gitlab # [ 294.904768] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"592d335067f7e8cdfe1767d1","created_at":"2026-08-11T10:00:03.357Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9305c23889db767b0f672a2058c9a00","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.396Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-592d335067f7e8cdfe1767d1: done: 0.02236 sec","job_status":"done","queue_duration_s":2.529603,"scheduling_latency_s":2.529619,"redis_calls":10,"redis_duration_s":0.002453,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000575,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032326,"duration_s":0.02236,"completed_at":"2026-08-11T10:00:05.947Z","load_balancing_strategy":"primary","db_duration_s":0.000671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.946488] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:05.949Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"100eb936c8f91d3dd3e5c5b5","created_at":"2026-08-11T10:00:03.417Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4a09ddc3fe6ca3095fe5ae28edbceca","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.438Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-100eb936c8f91d3dd3e5c5b5: start","job_status":"start","queue_duration_s":2.510951,"scheduling_latency_s":2.511} gitlab # [ 294.960788] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"100eb936c8f91d3dd3e5c5b5","created_at":"2026-08-11T10:00:03.417Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-01a985a442c14f4d","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4a09ddc3fe6ca3095fe5ae28edbceca","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.438Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-100eb936c8f91d3dd3e5c5b5: done: 0.070224 sec","job_status":"done","queue_duration_s":2.510951,"scheduling_latency_s":2.511,"redis_calls":21,"redis_duration_s":0.00592,"redis_read_bytes":20,"redis_write_bytes":4657,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002222,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1380,"redis_queues_calls":3,"redis_queues_duration_s":0.000885,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2314,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":502,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001256,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":461,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.033180219999999996,"duration_s":0.070224,"completed_at":"2026-08-11T10:00:06.019Z","load_balancing_strategy":"primary","db_duration_s":0.026607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.003256] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b5319a790a4d3c101a9b8768","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b5319a790a4d3c101a9b8768: start","job_status":"start","queue_duration_s":2.438733,"scheduling_latency_s":2.438751} gitlab # [ 295.015726] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b5319a790a4d3c101a9b8768","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b5319a790a4d3c101a9b8768: done: 0.035271 sec","job_status":"done","queue_duration_s":2.438733,"scheduling_latency_s":2.438751,"redis_calls":13,"redis_duration_s":0.003636,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003418,"duration_s":0.035271,"completed_at":"2026-08-11T10:00:06.056Z","load_balancing_strategy":"primary","db_duration_s":0.00749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.056213] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a2e41e46ff92e137f6d27370","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a2e41e46ff92e137f6d27370: start","job_status":"start","queue_duration_s":2.475624,"scheduling_latency_s":2.475642} gitlab # [ 295.068490] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a2e41e46ff92e137f6d27370","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a2e41e46ff92e137f6d27370: done: 0.020379 sec","job_status":"done","queue_duration_s":2.475624,"scheduling_latency_s":2.475642,"redis_calls":10,"redis_duration_s":0.0025640000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001482,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020379,"completed_at":"2026-08-11T10:00:06.078Z","load_balancing_strategy":"primary","db_duration_s":0.002518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.107242] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4cafef0fd7460d7b9fe51696","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4cafef0fd7460d7b9fe51696: start","job_status":"start","queue_duration_s":2.49747,"scheduling_latency_s":2.497488} gitlab # [ 295.119406] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4cafef0fd7460d7b9fe51696","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4cafef0fd7460d7b9fe51696: done: 0.019132 sec","job_status":"done","queue_duration_s":2.49747,"scheduling_latency_s":2.497488,"redis_calls":10,"redis_duration_s":0.002352,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019132,"completed_at":"2026-08-11T10:00:06.098Z","load_balancing_strategy":"primary","db_duration_s":0.00244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.160171] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"23182cd9e9e8ee701cd157eb","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-23182cd9e9e8ee701cd157eb: start","job_status":"start","queue_duration_s":2.517951,"scheduling_latency_s":2.517967} gitlab # [ 295.172394] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"23182cd9e9e8ee701cd157eb","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-23182cd9e9e8ee701cd157eb: done: 0.01928 sec","job_status":"done","queue_duration_s":2.517951,"scheduling_latency_s":2.517967,"redis_calls":10,"redis_duration_s":0.00251,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01928,"completed_at":"2026-08-11T10:00:06.119Z","load_balancing_strategy":"primary","db_duration_s":0.002459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.210896] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6afd47365a1748d3e66b3080","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6afd47365a1748d3e66b3080: start","job_status":"start","queue_duration_s":2.538638,"scheduling_latency_s":2.538654} gitlab # [ 295.223351] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6afd47365a1748d3e66b3080","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6afd47365a1748d3e66b3080: done: 0.01929 sec","job_status":"done","queue_duration_s":2.538638,"scheduling_latency_s":2.538654,"redis_calls":10,"redis_duration_s":0.0024809999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01929,"completed_at":"2026-08-11T10:00:06.140Z","load_balancing_strategy":"primary","db_duration_s":0.002491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.262268] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cf692b3d54abdb4d97ac8184","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cf692b3d54abdb4d97ac8184: start","job_status":"start","queue_duration_s":2.559306,"scheduling_latency_s":2.559323} gitlab # [ 295.274527] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cf692b3d54abdb4d97ac8184","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cf692b3d54abdb4d97ac8184: done: 0.01924 sec","job_status":"done","queue_duration_s":2.559306,"scheduling_latency_s":2.559323,"redis_calls":10,"redis_duration_s":0.0025180000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01924,"completed_at":"2026-08-11T10:00:06.160Z","load_balancing_strategy":"primary","db_duration_s":0.00252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.312583] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bd856aa72b67d632947e9c39","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bd856aa72b67d632947e9c39: start","job_status":"start","queue_duration_s":2.579874,"scheduling_latency_s":2.579891} gitlab # [ 295.324684] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bd856aa72b67d632947e9c39","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bd856aa72b67d632947e9c39: done: 0.019521 sec","job_status":"done","queue_duration_s":2.579874,"scheduling_latency_s":2.579891,"redis_calls":10,"redis_duration_s":0.002543,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001504,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019521,"completed_at":"2026-08-11T10:00:06.181Z","load_balancing_strategy":"primary","db_duration_s":0.002635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.363965] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d0e4fde0cd452e26831357a3","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d0e4fde0cd452e26831357a3: start","job_status":"start","queue_duration_s":2.600738,"scheduling_latency_s":2.600755} gitlab # [ 295.376476] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d0e4fde0cd452e26831357a3","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d0e4fde0cd452e26831357a3: done: 0.01905 sec","job_status":"done","queue_duration_s":2.600738,"scheduling_latency_s":2.600755,"redis_calls":10,"redis_duration_s":0.002389,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001396,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01905,"completed_at":"2026-08-11T10:00:06.202Z","load_balancing_strategy":"primary","db_duration_s":0.002472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.415840] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"31737420920a4963d2621f63","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-31737420920a4963d2621f63: start","job_status":"start","queue_duration_s":2.621195,"scheduling_latency_s":2.621211} gitlab # [ 295.428484] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"31737420920a4963d2621f63","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-31737420920a4963d2621f63: done: 0.019355 sec","job_status":"done","queue_duration_s":2.621195,"scheduling_latency_s":2.621211,"redis_calls":10,"redis_duration_s":0.002513,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001452,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019355,"completed_at":"2026-08-11T10:00:06.222Z","load_balancing_strategy":"primary","db_duration_s":0.002643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.467761] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d6f37f1cf27cc945160829ca","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d6f37f1cf27cc945160829ca: start","job_status":"start","queue_duration_s":2.641903,"scheduling_latency_s":2.641919} gitlab # [ 295.480640] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d6f37f1cf27cc945160829ca","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d6f37f1cf27cc945160829ca: done: 0.019222 sec","job_status":"done","queue_duration_s":2.641903,"scheduling_latency_s":2.641919,"redis_calls":10,"redis_duration_s":0.002404,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019222,"completed_at":"2026-08-11T10:00:06.243Z","load_balancing_strategy":"primary","db_duration_s":0.003139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.519888] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"120519be459fdae30b839afc","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-120519be459fdae30b839afc: start","job_status":"start","queue_duration_s":2.662525,"scheduling_latency_s":2.662542} gitlab # [ 295.532772] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"120519be459fdae30b839afc","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-120519be459fdae30b839afc: done: 0.019292 sec","job_status":"done","queue_duration_s":2.662525,"scheduling_latency_s":2.662542,"redis_calls":10,"redis_duration_s":0.002482,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001423,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019292,"completed_at":"2026-08-11T10:00:06.264Z","load_balancing_strategy":"primary","db_duration_s":0.00256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.573280] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4c05a013648f49468f5a9f4d","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4c05a013648f49468f5a9f4d: start","job_status":"start","queue_duration_s":2.683226,"scheduling_latency_s":2.683243} gitlab # [ 295.585895] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4c05a013648f49468f5a9f4d","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4c05a013648f49468f5a9f4d: done: 0.02594 sec","job_status":"done","queue_duration_s":2.683226,"scheduling_latency_s":2.683243,"redis_calls":10,"redis_duration_s":0.00861,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02594,"completed_at":"2026-08-11T10:00:06.291Z","load_balancing_strategy":"primary","db_duration_s":0.00247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.624190] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3f105a1ce5f3a2cfda903566","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3f105a1ce5f3a2cfda903566: start","job_status":"start","queue_duration_s":2.710652,"scheduling_latency_s":2.710668} gitlab # [ 295.636570] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3f105a1ce5f3a2cfda903566","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3f105a1ce5f3a2cfda903566: done: 0.019563 sec","job_status":"done","queue_duration_s":2.710652,"scheduling_latency_s":2.710668,"redis_calls":10,"redis_duration_s":0.002381,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001439,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019563,"completed_at":"2026-08-11T10:00:06.312Z","load_balancing_strategy":"primary","db_duration_s":0.002594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.675972] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0dc527ac47c509c1cd57532c","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0dc527ac47c509c1cd57532c: start","job_status":"start","queue_duration_s":2.731556,"scheduling_latency_s":2.731581} gitlab # [ 295.688591] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0dc527ac47c509c1cd57532c","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0dc527ac47c509c1cd57532c: done: 0.01923 sec","job_status":"done","queue_duration_s":2.731556,"scheduling_latency_s":2.731581,"redis_calls":10,"redis_duration_s":0.002391,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001374,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01923,"completed_at":"2026-08-11T10:00:06.333Z","load_balancing_strategy":"primary","db_duration_s":0.002497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.727398] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"db442431c8502fbb52d5e184","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-db442431c8502fbb52d5e184: start","job_status":"start","queue_duration_s":2.752278,"scheduling_latency_s":2.752295} gitlab # [ 295.739901] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"db442431c8502fbb52d5e184","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-db442431c8502fbb52d5e184: done: 0.02007 sec","job_status":"done","queue_duration_s":2.752278,"scheduling_latency_s":2.752295,"redis_calls":10,"redis_duration_s":0.0025199999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001503,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02007,"completed_at":"2026-08-11T10:00:06.354Z","load_balancing_strategy":"primary","db_duration_s":0.002597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.779846] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cba375c484aee094d619d158","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cba375c484aee094d619d158: start","job_status":"start","queue_duration_s":2.773882,"scheduling_latency_s":2.7739} gitlab # [ 295.792183] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cba375c484aee094d619d158","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cba375c484aee094d619d158: done: 0.019053 sec","job_status":"done","queue_duration_s":2.773882,"scheduling_latency_s":2.7739,"redis_calls":10,"redis_duration_s":0.0023870000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019053,"completed_at":"2026-08-11T10:00:06.375Z","load_balancing_strategy":"primary","db_duration_s":0.002471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.830666] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e170a4555ccf9cb2529f794f","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e170a4555ccf9cb2529f794f: start","job_status":"start","queue_duration_s":2.794317,"scheduling_latency_s":2.794335} gitlab # [ 295.842923] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e170a4555ccf9cb2529f794f","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e170a4555ccf9cb2529f794f: done: 0.019277 sec","job_status":"done","queue_duration_s":2.794317,"scheduling_latency_s":2.794335,"redis_calls":10,"redis_duration_s":0.002565,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019277,"completed_at":"2026-08-11T10:00:06.395Z","load_balancing_strategy":"primary","db_duration_s":0.002503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.881332] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9a0163f109d03777cf7de1a7","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9a0163f109d03777cf7de1a7: start","job_status":"start","queue_duration_s":2.81489,"scheduling_latency_s":2.814907} gitlab # [ 295.893585] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9a0163f109d03777cf7de1a7","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9a0163f109d03777cf7de1a7: done: 0.019131 sec","job_status":"done","queue_duration_s":2.81489,"scheduling_latency_s":2.814907,"redis_calls":10,"redis_duration_s":0.002543,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001539,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019131,"completed_at":"2026-08-11T10:00:06.416Z","load_balancing_strategy":"primary","db_duration_s":0.002403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.932207] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c88c2e41fedf925ee0eedf08","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c88c2e41fedf925ee0eedf08: start","job_status":"start","queue_duration_s":2.83541,"scheduling_latency_s":2.835426} gitlab # [ 295.944671] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c88c2e41fedf925ee0eedf08","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c88c2e41fedf925ee0eedf08: done: 0.020807 sec","job_status":"done","queue_duration_s":2.83541,"scheduling_latency_s":2.835426,"redis_calls":10,"redis_duration_s":0.0026030000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001515,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020807,"completed_at":"2026-08-11T10:00:06.438Z","load_balancing_strategy":"primary","db_duration_s":0.004918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 295.985240] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"feebe8525e8450792dff2444","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-feebe8525e8450792dff2444: start","job_status":"start","queue_duration_s":2.857618,"scheduling_latency_s":2.857635} gitlab # [ 295.997546] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"feebe8525e8450792dff2444","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-feebe8525e8450792dff2444: done: 0.019913 sec","job_status":"done","queue_duration_s":2.857618,"scheduling_latency_s":2.857635,"redis_calls":10,"redis_duration_s":0.002992,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019913,"completed_at":"2026-08-11T10:00:06.459Z","load_balancing_strategy":"primary","db_duration_s":0.002645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.036423] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"88c0a3291781376cbf3c8c52","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-88c0a3291781376cbf3c8c52: start","job_status":"start","queue_duration_s":2.87878,"scheduling_latency_s":2.878797} gitlab # [ 296.048681] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"88c0a3291781376cbf3c8c52","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-88c0a3291781376cbf3c8c52: done: 0.024813 sec","job_status":"done","queue_duration_s":2.87878,"scheduling_latency_s":2.878797,"redis_calls":10,"redis_duration_s":0.0050279999999999995,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024813,"completed_at":"2026-08-11T10:00:06.485Z","load_balancing_strategy":"primary","db_duration_s":0.005092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.087671] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c12ee1b4b923e0336a7a5bc8","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c12ee1b4b923e0336a7a5bc8: start","job_status":"start","queue_duration_s":2.904819,"scheduling_latency_s":2.904835} gitlab # [ 296.100386] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c12ee1b4b923e0336a7a5bc8","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c12ee1b4b923e0336a7a5bc8: done: 0.021209 sec","job_status":"done","queue_duration_s":2.904819,"scheduling_latency_s":2.904835,"redis_calls":10,"redis_duration_s":0.0034330000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002451,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021209,"completed_at":"2026-08-11T10:00:06.508Z","load_balancing_strategy":"primary","db_duration_s":0.00254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.139586] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"41f96c9b72d85a84c08a8318","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-41f96c9b72d85a84c08a8318: start","job_status":"start","queue_duration_s":2.927568,"scheduling_latency_s":2.927594} gitlab # [ 296.152253] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"41f96c9b72d85a84c08a8318","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-41f96c9b72d85a84c08a8318: done: 0.022355 sec","job_status":"done","queue_duration_s":2.927568,"scheduling_latency_s":2.927594,"redis_calls":10,"redis_duration_s":0.004111,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003285,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022355,"completed_at":"2026-08-11T10:00:06.532Z","load_balancing_strategy":"primary","db_duration_s":0.003408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.192409] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6d192f106e2c8e649a9269ec","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6d192f106e2c8e649a9269ec: start","job_status":"start","queue_duration_s":2.951206,"scheduling_latency_s":2.951223} gitlab # [ 296.204520] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6d192f106e2c8e649a9269ec","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6d192f106e2c8e649a9269ec: done: 0.019435 sec","job_status":"done","queue_duration_s":2.951206,"scheduling_latency_s":2.951223,"redis_calls":10,"redis_duration_s":0.002514,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001484,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019435,"completed_at":"2026-08-11T10:00:06.552Z","load_balancing_strategy":"primary","db_duration_s":0.002684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.243529] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"055ab775ba5ac140dfcc792e","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-055ab775ba5ac140dfcc792e: start","job_status":"start","queue_duration_s":2.971906,"scheduling_latency_s":2.971923} gitlab # [ 296.256197] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"055ab775ba5ac140dfcc792e","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-055ab775ba5ac140dfcc792e: done: 0.019492 sec","job_status":"done","queue_duration_s":2.971906,"scheduling_latency_s":2.971923,"redis_calls":10,"redis_duration_s":0.002536,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019492,"completed_at":"2026-08-11T10:00:06.573Z","load_balancing_strategy":"primary","db_duration_s":0.002564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.294924] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d425d040a1c8573c6458a90b","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d425d040a1c8573c6458a90b: start","job_status":"start","queue_duration_s":2.992833,"scheduling_latency_s":2.99285} gitlab # [ 296.307560] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d425d040a1c8573c6458a90b","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d425d040a1c8573c6458a90b: done: 0.019138 sec","job_status":"done","queue_duration_s":2.992833,"scheduling_latency_s":2.99285,"redis_calls":10,"redis_duration_s":0.002372,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019138,"completed_at":"2026-08-11T10:00:06.594Z","load_balancing_strategy":"primary","db_duration_s":0.002486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.346823] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"779ba171aa6874c22a3c156c","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-779ba171aa6874c22a3c156c: start","job_status":"start","queue_duration_s":3.013353,"scheduling_latency_s":3.013369} gitlab # [ 296.359270] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"779ba171aa6874c22a3c156c","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-779ba171aa6874c22a3c156c: done: 0.019276 sec","job_status":"done","queue_duration_s":3.013353,"scheduling_latency_s":3.013369,"redis_calls":10,"redis_duration_s":0.002496,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001411,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019276,"completed_at":"2026-08-11T10:00:06.614Z","load_balancing_strategy":"primary","db_duration_s":0.00259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.399435] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"87738dec4c1be2387544c3da","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-87738dec4c1be2387544c3da: start","job_status":"start","queue_duration_s":3.034018,"scheduling_latency_s":3.034034} gitlab # [ 296.411803] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"87738dec4c1be2387544c3da","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-87738dec4c1be2387544c3da: done: 0.019035 sec","job_status":"done","queue_duration_s":3.034018,"scheduling_latency_s":3.034034,"redis_calls":10,"redis_duration_s":0.002392,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001371,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019035,"completed_at":"2026-08-11T10:00:06.635Z","load_balancing_strategy":"primary","db_duration_s":0.002444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.450866] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6683c21ee0a3746333d6084e","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6683c21ee0a3746333d6084e: start","job_status":"start","queue_duration_s":3.05443,"scheduling_latency_s":3.054446} gitlab # [ 296.463441] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6683c21ee0a3746333d6084e","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6683c21ee0a3746333d6084e: done: 0.020086 sec","job_status":"done","queue_duration_s":3.05443,"scheduling_latency_s":3.054446,"redis_calls":10,"redis_duration_s":0.003064,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001966,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020086,"completed_at":"2026-08-11T10:00:06.656Z","load_balancing_strategy":"primary","db_duration_s":0.002551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.502393] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d44d8163c2fcdfa9f7e08b4b","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d44d8163c2fcdfa9f7e08b4b: start","job_status":"start","queue_duration_s":3.075974,"scheduling_latency_s":3.075991} gitlab # [ 296.514582] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d44d8163c2fcdfa9f7e08b4b","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d44d8163c2fcdfa9f7e08b4b: done: 0.018973 sec","job_status":"done","queue_duration_s":3.075974,"scheduling_latency_s":3.075991,"redis_calls":10,"redis_duration_s":0.002399,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018973,"completed_at":"2026-08-11T10:00:06.677Z","load_balancing_strategy":"primary","db_duration_s":0.002481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.553829] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"79f81197dca9a28d88918ac1","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-79f81197dca9a28d88918ac1: start","job_status":"start","queue_duration_s":3.096394,"scheduling_latency_s":3.09641} gitlab # [ 296.565762] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"79f81197dca9a28d88918ac1","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-79f81197dca9a28d88918ac1: done: 0.048937 sec","job_status":"done","queue_duration_s":3.096394,"scheduling_latency_s":3.09641,"redis_calls":10,"redis_duration_s":0.021467,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.015355,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048937,"completed_at":"2026-08-11T10:00:06.727Z","load_balancing_strategy":"primary","db_duration_s":0.012859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.604482] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a7038de28f520788af28487e","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a7038de28f520788af28487e: start","job_status":"start","queue_duration_s":3.155348,"scheduling_latency_s":3.155371} gitlab # [ 296.616586] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a7038de28f520788af28487e","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a7038de28f520788af28487e: done: 0.030187 sec","job_status":"done","queue_duration_s":3.155348,"scheduling_latency_s":3.155371,"redis_calls":10,"redis_duration_s":0.006393,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030187,"completed_at":"2026-08-11T10:00:06.767Z","load_balancing_strategy":"primary","db_duration_s":0.002369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.654304] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7282bfc1e84294212b98a271","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7282bfc1e84294212b98a271: start","job_status":"start","queue_duration_s":3.18705,"scheduling_latency_s":3.187073} gitlab # [ 296.666501] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7282bfc1e84294212b98a271","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7282bfc1e84294212b98a271: done: 0.023444 sec","job_status":"done","queue_duration_s":3.18705,"scheduling_latency_s":3.187073,"redis_calls":10,"redis_duration_s":0.001692,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023444,"completed_at":"2026-08-11T10:00:06.792Z","load_balancing_strategy":"primary","db_duration_s":0.002808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.704667] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"780d02267ebf1043b8bc6a09","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-780d02267ebf1043b8bc6a09: start","job_status":"start","queue_duration_s":3.211845,"scheduling_latency_s":3.211866} gitlab # [ 296.716711] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"780d02267ebf1043b8bc6a09","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-780d02267ebf1043b8bc6a09: done: 0.02176 sec","job_status":"done","queue_duration_s":3.211845,"scheduling_latency_s":3.211866,"redis_calls":10,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02176,"completed_at":"2026-08-11T10:00:06.815Z","load_balancing_strategy":"primary","db_duration_s":0.002774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.754779] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4b2f1db8908953ccdfdff48f","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4b2f1db8908953ccdfdff48f: start","job_status":"start","queue_duration_s":3.234858,"scheduling_latency_s":3.234878} gitlab # [ 296.766949] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4b2f1db8908953ccdfdff48f","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4b2f1db8908953ccdfdff48f: done: 0.019863 sec","job_status":"done","queue_duration_s":3.234858,"scheduling_latency_s":3.234878,"redis_calls":10,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019863,"completed_at":"2026-08-11T10:00:06.837Z","load_balancing_strategy":"primary","db_duration_s":0.002314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.806640] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6461a795d9cb871a002a713c","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6461a795d9cb871a002a713c: start","job_status":"start","queue_duration_s":3.255924,"scheduling_latency_s":3.255943} gitlab # [ 296.818904] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6461a795d9cb871a002a713c","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6461a795d9cb871a002a713c: done: 0.019309 sec","job_status":"done","queue_duration_s":3.255924,"scheduling_latency_s":3.255943,"redis_calls":10,"redis_duration_s":0.00151,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019309,"completed_at":"2026-08-11T10:00:06.857Z","load_balancing_strategy":"primary","db_duration_s":0.002734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.857101] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"159d8d064308d90e3d4379d2","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-159d8d064308d90e3d4379d2: start","job_status":"start","queue_duration_s":3.276337,"scheduling_latency_s":3.276354} gitlab # [ 296.869257] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"159d8d064308d90e3d4379d2","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-159d8d064308d90e3d4379d2: done: 0.018242 sec","job_status":"done","queue_duration_s":3.276337,"scheduling_latency_s":3.276354,"redis_calls":10,"redis_duration_s":0.0013449999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000792,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018242,"completed_at":"2026-08-11T10:00:06.876Z","load_balancing_strategy":"primary","db_duration_s":0.002415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.908189] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f6c0027e866bd2a9efbaf1cb","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f6c0027e866bd2a9efbaf1cb: start","job_status":"start","queue_duration_s":3.295628,"scheduling_latency_s":3.295645} gitlab # [ 296.920489] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f6c0027e866bd2a9efbaf1cb","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f6c0027e866bd2a9efbaf1cb: done: 0.017946 sec","job_status":"done","queue_duration_s":3.295628,"scheduling_latency_s":3.295645,"redis_calls":10,"redis_duration_s":0.001236,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017946,"completed_at":"2026-08-11T10:00:06.895Z","load_balancing_strategy":"primary","db_duration_s":0.002183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 296.959699] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e38f49b8276295e7ea28cd29","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e38f49b8276295e7ea28cd29: start","job_status":"start","queue_duration_s":3.314624,"scheduling_latency_s":3.314641} gitlab # [ 296.972215] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e38f49b8276295e7ea28cd29","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e38f49b8276295e7ea28cd29: done: 0.018757 sec","job_status":"done","queue_duration_s":3.314624,"scheduling_latency_s":3.314641,"redis_calls":10,"redis_duration_s":0.001291,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018757,"completed_at":"2026-08-11T10:00:06.915Z","load_balancing_strategy":"primary","db_duration_s":0.002349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.011693] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fe8c260350c9275691b9ebdb","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fe8c260350c9275691b9ebdb: start","job_status":"start","queue_duration_s":3.334616,"scheduling_latency_s":3.334633} gitlab # [ 297.024170] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fe8c260350c9275691b9ebdb","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fe8c260350c9275691b9ebdb: done: 0.018668 sec","job_status":"done","queue_duration_s":3.334616,"scheduling_latency_s":3.334633,"redis_calls":10,"redis_duration_s":0.001255,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018668,"completed_at":"2026-08-11T10:00:06.935Z","load_balancing_strategy":"primary","db_duration_s":0.003055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.062825] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"741d5c38199460efdd78f27f","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-741d5c38199460efdd78f27f: start","job_status":"start","queue_duration_s":3.354323,"scheduling_latency_s":3.354339} gitlab # [ 297.075245] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"741d5c38199460efdd78f27f","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-741d5c38199460efdd78f27f: done: 0.018807 sec","job_status":"done","queue_duration_s":3.354323,"scheduling_latency_s":3.354339,"redis_calls":10,"redis_duration_s":0.001263,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018807,"completed_at":"2026-08-11T10:00:06.955Z","load_balancing_strategy":"primary","db_duration_s":0.002546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.113956] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7fa8c8ba86fdd023c96c66f1","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7fa8c8ba86fdd023c96c66f1: start","job_status":"start","queue_duration_s":3.374202,"scheduling_latency_s":3.374218} gitlab # [ 297.126154] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7fa8c8ba86fdd023c96c66f1","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7fa8c8ba86fdd023c96c66f1: done: 0.018249 sec","job_status":"done","queue_duration_s":3.374202,"scheduling_latency_s":3.374218,"redis_calls":10,"redis_duration_s":0.001262,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018249,"completed_at":"2026-08-11T10:00:06.974Z","load_balancing_strategy":"primary","db_duration_s":0.00225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.164852] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8d585e2b2b4ac79181c45cef","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8d585e2b2b4ac79181c45cef: start","job_status":"start","queue_duration_s":3.393595,"scheduling_latency_s":3.393611} gitlab # [ 297.176899] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8d585e2b2b4ac79181c45cef","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8d585e2b2b4ac79181c45cef: done: 0.017893 sec","job_status":"done","queue_duration_s":3.393595,"scheduling_latency_s":3.393611,"redis_calls":10,"redis_duration_s":0.001225,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017893,"completed_at":"2026-08-11T10:00:06.993Z","load_balancing_strategy":"primary","db_duration_s":0.002233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.215929] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:06.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2dd449e903537f97612840b7","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2dd449e903537f97612840b7: start","job_status":"start","queue_duration_s":3.412607,"scheduling_latency_s":3.412624} gitlab # [ 297.228450] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2dd449e903537f97612840b7","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2dd449e903537f97612840b7: done: 0.01811 sec","job_status":"done","queue_duration_s":3.412607,"scheduling_latency_s":3.412624,"redis_calls":10,"redis_duration_s":0.001286,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01811,"completed_at":"2026-08-11T10:00:07.013Z","load_balancing_strategy":"primary","db_duration_s":0.002194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.267133] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3ccd621d02c15d0a34a7302d","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3ccd621d02c15d0a34a7302d: start","job_status":"start","queue_duration_s":3.431873,"scheduling_latency_s":3.431889} gitlab # [ 297.279660] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3ccd621d02c15d0a34a7302d","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3ccd621d02c15d0a34a7302d: done: 0.018175 sec","job_status":"done","queue_duration_s":3.431873,"scheduling_latency_s":3.431889,"redis_calls":10,"redis_duration_s":0.001242,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018175,"completed_at":"2026-08-11T10:00:07.032Z","load_balancing_strategy":"primary","db_duration_s":0.002209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.318132] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ab4cbf0dcaaec23d77c1f501","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ab4cbf0dcaaec23d77c1f501: start","job_status":"start","queue_duration_s":3.451161,"scheduling_latency_s":3.451179} gitlab # [ 297.330190] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ab4cbf0dcaaec23d77c1f501","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ab4cbf0dcaaec23d77c1f501: done: 0.018711 sec","job_status":"done","queue_duration_s":3.451161,"scheduling_latency_s":3.451179,"redis_calls":10,"redis_duration_s":0.0012720000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018711,"completed_at":"2026-08-11T10:00:07.052Z","load_balancing_strategy":"primary","db_duration_s":0.00214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.368561] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"202174c260703b85fe2f94fa","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-202174c260703b85fe2f94fa: start","job_status":"start","queue_duration_s":3.470902,"scheduling_latency_s":3.470919} gitlab # [ 297.380588] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"202174c260703b85fe2f94fa","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-202174c260703b85fe2f94fa: done: 0.026275 sec","job_status":"done","queue_duration_s":3.470902,"scheduling_latency_s":3.470919,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026275,"completed_at":"2026-08-11T10:00:07.079Z","load_balancing_strategy":"primary","db_duration_s":0.002177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.419514] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5af34a2739e77f5441c5e0b1","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5af34a2739e77f5441c5e0b1: start","job_status":"start","queue_duration_s":3.498424,"scheduling_latency_s":3.49844} gitlab # [ 297.431625] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5af34a2739e77f5441c5e0b1","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5af34a2739e77f5441c5e0b1: done: 0.01835 sec","job_status":"done","queue_duration_s":3.498424,"scheduling_latency_s":3.49844,"redis_calls":10,"redis_duration_s":0.001254,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01835,"completed_at":"2026-08-11T10:00:07.099Z","load_balancing_strategy":"primary","db_duration_s":0.002346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.469812] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"26e26c36e935d20f8f344c5d","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-26e26c36e935d20f8f344c5d: start","job_status":"start","queue_duration_s":3.517816,"scheduling_latency_s":3.517833} gitlab # [ 297.481860] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"26e26c36e935d20f8f344c5d","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-26e26c36e935d20f8f344c5d: done: 0.018459 sec","job_status":"done","queue_duration_s":3.517816,"scheduling_latency_s":3.517833,"redis_calls":10,"redis_duration_s":0.001275,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018459,"completed_at":"2026-08-11T10:00:07.118Z","load_balancing_strategy":"primary","db_duration_s":0.002285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.519916] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6d14b0ee6691655ad557436","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6d14b0ee6691655ad557436: start","job_status":"start","queue_duration_s":3.537347,"scheduling_latency_s":3.537363} gitlab # [ 297.532502] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e6d14b0ee6691655ad557436","created_at":"2026-08-11T10:00:03.350Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-255c5977e6ff4654","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"dc3491865eda0e52af5323e7f208cc73","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:03.582Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e6d14b0ee6691655ad557436: done: 0.018577 sec","job_status":"done","queue_duration_s":3.537347,"scheduling_latency_s":3.537363,"redis_calls":10,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018577,"completed_at":"2026-08-11T10:00:07.138Z","load_balancing_strategy":"primary","db_duration_s":0.002248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.571007] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bb5a252be5f5d8d829dbb17","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bb5a252be5f5d8d829dbb17: start","job_status":"start","queue_duration_s":2.917945,"scheduling_latency_s":2.917961} gitlab # [ 297.583416] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bb5a252be5f5d8d829dbb17","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bb5a252be5f5d8d829dbb17: done: 0.014952 sec","job_status":"done","queue_duration_s":2.917945,"scheduling_latency_s":2.917961,"redis_calls":13,"redis_duration_s":0.001371,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014952,"completed_at":"2026-08-11T10:00:07.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.623870] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfca87243942eff9bcf8c1e","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfca87243942eff9bcf8c1e: start","job_status":"start","queue_duration_s":2.933932,"scheduling_latency_s":2.933948} gitlab # [ 297.636573] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfca87243942eff9bcf8c1e","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfca87243942eff9bcf8c1e: done: 0.014095 sec","job_status":"done","queue_duration_s":2.933932,"scheduling_latency_s":2.933948,"redis_calls":13,"redis_duration_s":0.0013900000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014095,"completed_at":"2026-08-11T10:00:07.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.675545] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c59fb6442c8f630e017d3749","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c59fb6442c8f630e017d3749: start","job_status":"start","queue_duration_s":2.949629,"scheduling_latency_s":2.949645} gitlab # [ 297.687849] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c59fb6442c8f630e017d3749","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c59fb6442c8f630e017d3749: done: 0.014121 sec","job_status":"done","queue_duration_s":2.949629,"scheduling_latency_s":2.949645,"redis_calls":13,"redis_duration_s":0.001353,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014121,"completed_at":"2026-08-11T10:00:07.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.726930] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8331e2d5f53bf1e5d2bc509","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8331e2d5f53bf1e5d2bc509: start","job_status":"start","queue_duration_s":2.964846,"scheduling_latency_s":2.964862} gitlab # [ 297.739526] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8331e2d5f53bf1e5d2bc509","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8331e2d5f53bf1e5d2bc509: done: 0.014312 sec","job_status":"done","queue_duration_s":2.964846,"scheduling_latency_s":2.964862,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014312,"completed_at":"2026-08-11T10:00:07.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.780402] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e5e95e24bc19f94241757a5","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e5e95e24bc19f94241757a5: start","job_status":"start","queue_duration_s":2.980306,"scheduling_latency_s":2.980485} gitlab # [ 297.792764] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e5e95e24bc19f94241757a5","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e5e95e24bc19f94241757a5: done: 0.063271 sec","job_status":"done","queue_duration_s":2.980306,"scheduling_latency_s":2.980485,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.063271,"completed_at":"2026-08-11T10:00:07.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.832359] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"344798fe830d4437cc177ce2","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-344798fe830d4437cc177ce2: start","job_status":"start","queue_duration_s":3.044711,"scheduling_latency_s":3.044727} gitlab # [ 297.844538] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"344798fe830d4437cc177ce2","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-344798fe830d4437cc177ce2: done: 0.014858 sec","job_status":"done","queue_duration_s":3.044711,"scheduling_latency_s":3.044727,"redis_calls":13,"redis_duration_s":0.002231,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014858,"completed_at":"2026-08-11T10:00:07.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.883773] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f3c0a19ab91aa18c786bc37","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f3c0a19ab91aa18c786bc37: start","job_status":"start","queue_duration_s":3.060646,"scheduling_latency_s":3.060662} gitlab # [ 297.896400] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f3c0a19ab91aa18c786bc37","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f3c0a19ab91aa18c786bc37: done: 0.014753 sec","job_status":"done","queue_duration_s":3.060646,"scheduling_latency_s":3.060662,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014753,"completed_at":"2026-08-11T10:00:07.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.935580] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe4b29b68d9feeb46790bc92","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe4b29b68d9feeb46790bc92: start","job_status":"start","queue_duration_s":3.077371,"scheduling_latency_s":3.077388} gitlab # [ 297.947939] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe4b29b68d9feeb46790bc92","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe4b29b68d9feeb46790bc92: done: 0.01482 sec","job_status":"done","queue_duration_s":3.077371,"scheduling_latency_s":3.077388,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01482,"completed_at":"2026-08-11T10:00:07.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 297.987707] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6893d72819fd2d0ebc581c5c","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6893d72819fd2d0ebc581c5c: start","job_status":"start","queue_duration_s":3.093227,"scheduling_latency_s":3.093243} gitlab # [ 298.000455] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6893d72819fd2d0ebc581c5c","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6893d72819fd2d0ebc581c5c: done: 0.015061 sec","job_status":"done","queue_duration_s":3.093227,"scheduling_latency_s":3.093243,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015061,"completed_at":"2026-08-11T10:00:07.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.040489] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e63a7caed044377cfa76917a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e63a7caed044377cfa76917a: start","job_status":"start","queue_duration_s":3.113053,"scheduling_latency_s":3.11307} gitlab # [ 298.052970] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e63a7caed044377cfa76917a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e63a7caed044377cfa76917a: done: 0.015038 sec","job_status":"done","queue_duration_s":3.113053,"scheduling_latency_s":3.11307,"redis_calls":13,"redis_duration_s":0.0013800000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015038,"completed_at":"2026-08-11T10:00:07.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.092291] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b85d0f28bafc6f971b15aad3","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b85d0f28bafc6f971b15aad3: start","job_status":"start","queue_duration_s":3.129112,"scheduling_latency_s":3.129128} gitlab # [ 298.104621] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b85d0f28bafc6f971b15aad3","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b85d0f28bafc6f971b15aad3: done: 0.016351 sec","job_status":"done","queue_duration_s":3.129112,"scheduling_latency_s":3.129128,"redis_calls":13,"redis_duration_s":0.001343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016351,"completed_at":"2026-08-11T10:00:07.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.144106] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"268b2eb4aaf5a49adae86d70","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-268b2eb4aaf5a49adae86d70: start","job_status":"start","queue_duration_s":3.146522,"scheduling_latency_s":3.146537} gitlab # [ 298.156476] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"268b2eb4aaf5a49adae86d70","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-268b2eb4aaf5a49adae86d70: done: 0.01543 sec","job_status":"done","queue_duration_s":3.146522,"scheduling_latency_s":3.146537,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01543,"completed_at":"2026-08-11T10:00:07.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.195796] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61c16755444ab16ec42587e7","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61c16755444ab16ec42587e7: start","job_status":"start","queue_duration_s":3.162965,"scheduling_latency_s":3.162981} gitlab # [ 298.208529] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61c16755444ab16ec42587e7","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61c16755444ab16ec42587e7: done: 0.01477 sec","job_status":"done","queue_duration_s":3.162965,"scheduling_latency_s":3.162981,"redis_calls":13,"redis_duration_s":0.0013779999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01477,"completed_at":"2026-08-11T10:00:07.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.249042] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40fbdf92f09cabf133bd10e5","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40fbdf92f09cabf133bd10e5: start","job_status":"start","queue_duration_s":3.17875,"scheduling_latency_s":3.178766} gitlab # [ 298.261165] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40fbdf92f09cabf133bd10e5","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40fbdf92f09cabf133bd10e5: done: 0.014865 sec","job_status":"done","queue_duration_s":3.17875,"scheduling_latency_s":3.178766,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014865,"completed_at":"2026-08-11T10:00:07.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.300511] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62b7507349d658ab70ce7012","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62b7507349d658ab70ce7012: start","job_status":"start","queue_duration_s":3.195679,"scheduling_latency_s":3.195696} gitlab # [ 298.312869] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62b7507349d658ab70ce7012","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62b7507349d658ab70ce7012: done: 0.01479 sec","job_status":"done","queue_duration_s":3.195679,"scheduling_latency_s":3.195696,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01479,"completed_at":"2026-08-11T10:00:07.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.352120] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f289c5e9b24181e673cf19f0","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f289c5e9b24181e673cf19f0: start","job_status":"start","queue_duration_s":3.211478,"scheduling_latency_s":3.211494} gitlab # [ 298.364565] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f289c5e9b24181e673cf19f0","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f289c5e9b24181e673cf19f0: done: 0.014867 sec","job_status":"done","queue_duration_s":3.211478,"scheduling_latency_s":3.211494,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014867,"completed_at":"2026-08-11T10:00:07.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.404023] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"088eced0e1b80c16f4306ad6","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-088eced0e1b80c16f4306ad6: start","job_status":"start","queue_duration_s":3.227382,"scheduling_latency_s":3.227398} gitlab # [ 298.417595] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"088eced0e1b80c16f4306ad6","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-088eced0e1b80c16f4306ad6: done: 0.015073 sec","job_status":"done","queue_duration_s":3.227382,"scheduling_latency_s":3.227398,"redis_calls":13,"redis_duration_s":0.001613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015073,"completed_at":"2026-08-11T10:00:07.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.457355] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70bed353590c9c3931043e33","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70bed353590c9c3931043e33: start","job_status":"start","queue_duration_s":3.243488,"scheduling_latency_s":3.243504} gitlab # [ 298.469742] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70bed353590c9c3931043e33","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70bed353590c9c3931043e33: done: 0.015098 sec","job_status":"done","queue_duration_s":3.243488,"scheduling_latency_s":3.243504,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015098,"completed_at":"2026-08-11T10:00:07.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.508737] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef7d94e1a0a8a8deabc4cdf1","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef7d94e1a0a8a8deabc4cdf1: start","job_status":"start","queue_duration_s":3.26208,"scheduling_latency_s":3.262097} gitlab # [ 298.521218] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef7d94e1a0a8a8deabc4cdf1","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef7d94e1a0a8a8deabc4cdf1: done: 0.015383 sec","job_status":"done","queue_duration_s":3.26208,"scheduling_latency_s":3.262097,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015383,"completed_at":"2026-08-11T10:00:07.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.560639] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dae64b5646231e6cc7aaa428","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dae64b5646231e6cc7aaa428: start","job_status":"start","queue_duration_s":3.278499,"scheduling_latency_s":3.278515} gitlab # [ 298.572916] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dae64b5646231e6cc7aaa428","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dae64b5646231e6cc7aaa428: done: 0.01494 sec","job_status":"done","queue_duration_s":3.278499,"scheduling_latency_s":3.278515,"redis_calls":13,"redis_duration_s":0.001377,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01494,"completed_at":"2026-08-11T10:00:07.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.612434] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de7ec9d16fbae083acea2d2d","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de7ec9d16fbae083acea2d2d: start","job_status":"start","queue_duration_s":3.294506,"scheduling_latency_s":3.294522} gitlab # [ 298.625873] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de7ec9d16fbae083acea2d2d","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de7ec9d16fbae083acea2d2d: done: 0.014901 sec","job_status":"done","queue_duration_s":3.294506,"scheduling_latency_s":3.294522,"redis_calls":13,"redis_duration_s":0.001372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014901,"completed_at":"2026-08-11T10:00:07.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.664985] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc30bb1b2886c72b7bf738f3","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc30bb1b2886c72b7bf738f3: start","job_status":"start","queue_duration_s":3.311577,"scheduling_latency_s":3.311593} gitlab # [ 298.677492] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc30bb1b2886c72b7bf738f3","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc30bb1b2886c72b7bf738f3: done: 0.016838 sec","job_status":"done","queue_duration_s":3.311577,"scheduling_latency_s":3.311593,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016838,"completed_at":"2026-08-11T10:00:07.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.716681] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fd70502e5a83d07672db75c","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fd70502e5a83d07672db75c: start","job_status":"start","queue_duration_s":3.329476,"scheduling_latency_s":3.329491} gitlab # [ 298.728906] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fd70502e5a83d07672db75c","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fd70502e5a83d07672db75c: done: 0.015825 sec","job_status":"done","queue_duration_s":3.329476,"scheduling_latency_s":3.329491,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015825,"completed_at":"2026-08-11T10:00:07.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.768241] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d697112a9997b76a0b2ffbdf","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d697112a9997b76a0b2ffbdf: start","job_status":"start","queue_duration_s":3.346423,"scheduling_latency_s":3.34644} gitlab # [ 298.780457] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d697112a9997b76a0b2ffbdf","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d697112a9997b76a0b2ffbdf: done: 0.015789 sec","job_status":"done","queue_duration_s":3.346423,"scheduling_latency_s":3.34644,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015789,"completed_at":"2026-08-11T10:00:07.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.819873] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfc8b420b26e24ae88a815b1","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfc8b420b26e24ae88a815b1: start","job_status":"start","queue_duration_s":3.363253,"scheduling_latency_s":3.363269} gitlab # [ 298.833553] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfc8b420b26e24ae88a815b1","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfc8b420b26e24ae88a815b1: done: 0.016073 sec","job_status":"done","queue_duration_s":3.363253,"scheduling_latency_s":3.363269,"redis_calls":13,"redis_duration_s":0.00136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016073,"completed_at":"2026-08-11T10:00:07.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.872818] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7884503bb48960802c89ba","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7884503bb48960802c89ba: start","job_status":"start","queue_duration_s":3.380465,"scheduling_latency_s":3.380481} gitlab # [ 298.885280] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7884503bb48960802c89ba","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7884503bb48960802c89ba: done: 0.014945 sec","job_status":"done","queue_duration_s":3.380465,"scheduling_latency_s":3.380481,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014945,"completed_at":"2026-08-11T10:00:07.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.924985] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43f76e37161ef9aa307da778","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43f76e37161ef9aa307da778: start","job_status":"start","queue_duration_s":3.396447,"scheduling_latency_s":3.396463} gitlab # [ 298.937290] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43f76e37161ef9aa307da778","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43f76e37161ef9aa307da778: done: 0.014968 sec","job_status":"done","queue_duration_s":3.396447,"scheduling_latency_s":3.396463,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014968,"completed_at":"2026-08-11T10:00:07.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 298.976036] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"832ce5e7ed0a85c0578e2a14","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-832ce5e7ed0a85c0578e2a14: start","job_status":"start","queue_duration_s":3.412505,"scheduling_latency_s":3.412522} gitlab # [ 298.988334] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"832ce5e7ed0a85c0578e2a14","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-832ce5e7ed0a85c0578e2a14: done: 0.014488 sec","job_status":"done","queue_duration_s":3.412505,"scheduling_latency_s":3.412522,"redis_calls":13,"redis_duration_s":0.0013419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014488,"completed_at":"2026-08-11T10:00:07.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.027096] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"609b0874a36967d6da1dcd7a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-609b0874a36967d6da1dcd7a: start","job_status":"start","queue_duration_s":3.429209,"scheduling_latency_s":3.429225} gitlab # [ 299.040509] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"609b0874a36967d6da1dcd7a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-609b0874a36967d6da1dcd7a: done: 0.014981 sec","job_status":"done","queue_duration_s":3.429209,"scheduling_latency_s":3.429225,"redis_calls":13,"redis_duration_s":0.002452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014981,"completed_at":"2026-08-11T10:00:07.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.079053] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd07c079c8de9ee8dc8ccccc","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd07c079c8de9ee8dc8ccccc: start","job_status":"start","queue_duration_s":3.445225,"scheduling_latency_s":3.445241} gitlab # [ 299.091204] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd07c079c8de9ee8dc8ccccc","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd07c079c8de9ee8dc8ccccc: done: 0.015022 sec","job_status":"done","queue_duration_s":3.445225,"scheduling_latency_s":3.445241,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015022,"completed_at":"2026-08-11T10:00:07.681Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.129843] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d219a62532747fea85cad879","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d219a62532747fea85cad879: start","job_status":"start","queue_duration_s":3.461262,"scheduling_latency_s":3.461278} gitlab # [ 299.142103] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d219a62532747fea85cad879","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d219a62532747fea85cad879: done: 0.014487 sec","job_status":"done","queue_duration_s":3.461262,"scheduling_latency_s":3.461278,"redis_calls":13,"redis_duration_s":0.001356,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014487,"completed_at":"2026-08-11T10:00:07.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.180633] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"496cdebe739077fbcf1d5cf8","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-496cdebe739077fbcf1d5cf8: start","job_status":"start","queue_duration_s":3.477046,"scheduling_latency_s":3.477062} gitlab # [ 299.192583] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"496cdebe739077fbcf1d5cf8","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-496cdebe739077fbcf1d5cf8: done: 0.016351 sec","job_status":"done","queue_duration_s":3.477046,"scheduling_latency_s":3.477062,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016351,"completed_at":"2026-08-11T10:00:07.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.231660] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2263ba9e7a14da66f3c23126","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2263ba9e7a14da66f3c23126: start","job_status":"start","queue_duration_s":3.495497,"scheduling_latency_s":3.495513} gitlab # [ 299.245670] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2263ba9e7a14da66f3c23126","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2263ba9e7a14da66f3c23126: done: 0.015085 sec","job_status":"done","queue_duration_s":3.495497,"scheduling_latency_s":3.495513,"redis_calls":13,"redis_duration_s":0.0023,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015085,"completed_at":"2026-08-11T10:00:07.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.285501] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e43d359d0132eefb7dc65c9","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e43d359d0132eefb7dc65c9: start","job_status":"start","queue_duration_s":3.51158,"scheduling_latency_s":3.511596} gitlab # [ 299.298226] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e43d359d0132eefb7dc65c9","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e43d359d0132eefb7dc65c9: done: 0.014962 sec","job_status":"done","queue_duration_s":3.51158,"scheduling_latency_s":3.511596,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014962,"completed_at":"2026-08-11T10:00:07.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.337458] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ebdc4c73317193ca916b63c","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ebdc4c73317193ca916b63c: start","job_status":"start","queue_duration_s":3.527572,"scheduling_latency_s":3.527588} gitlab # [ 299.349898] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ebdc4c73317193ca916b63c","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ebdc4c73317193ca916b63c: done: 0.015533 sec","job_status":"done","queue_duration_s":3.527572,"scheduling_latency_s":3.527588,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015533,"completed_at":"2026-08-11T10:00:07.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.389341] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3ba9075eba63095147f058f","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3ba9075eba63095147f058f: start","job_status":"start","queue_duration_s":3.54518,"scheduling_latency_s":3.545197} gitlab # [ 299.401561] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3ba9075eba63095147f058f","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3ba9075eba63095147f058f: done: 0.014848 sec","job_status":"done","queue_duration_s":3.54518,"scheduling_latency_s":3.545197,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014848,"completed_at":"2026-08-11T10:00:07.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.442062] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fcd332ef96c2d8b03c5b90e","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fcd332ef96c2d8b03c5b90e: start","job_status":"start","queue_duration_s":3.561085,"scheduling_latency_s":3.561101} gitlab # [ 299.454717] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fcd332ef96c2d8b03c5b90e","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fcd332ef96c2d8b03c5b90e: done: 0.017138 sec","job_status":"done","queue_duration_s":3.561085,"scheduling_latency_s":3.561101,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017138,"completed_at":"2026-08-11T10:00:07.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.494699] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cecf6441a55491ccc02dea95","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cecf6441a55491ccc02dea95: start","job_status":"start","queue_duration_s":3.579274,"scheduling_latency_s":3.57929} gitlab # [ 299.507137] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cecf6441a55491ccc02dea95","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cecf6441a55491ccc02dea95: done: 0.015181 sec","job_status":"done","queue_duration_s":3.579274,"scheduling_latency_s":3.57929,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015181,"completed_at":"2026-08-11T10:00:07.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.547156] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e9c09ff1668f2adfe8fcb5a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e9c09ff1668f2adfe8fcb5a: start","job_status":"start","queue_duration_s":3.595491,"scheduling_latency_s":3.595506} gitlab # [ 299.559726] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e9c09ff1668f2adfe8fcb5a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e9c09ff1668f2adfe8fcb5a: done: 0.015228 sec","job_status":"done","queue_duration_s":3.595491,"scheduling_latency_s":3.595506,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015228,"completed_at":"2026-08-11T10:00:07.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.598775] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3ea5ad839fd77632391d66d","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3ea5ad839fd77632391d66d: start","job_status":"start","queue_duration_s":3.614429,"scheduling_latency_s":3.614445} gitlab # [ 299.611233] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3ea5ad839fd77632391d66d","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3ea5ad839fd77632391d66d: done: 0.015713 sec","job_status":"done","queue_duration_s":3.614429,"scheduling_latency_s":3.614445,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015713,"completed_at":"2026-08-11T10:00:07.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.650920] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c4f01d52664d42d372bc09","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c4f01d52664d42d372bc09: start","job_status":"start","queue_duration_s":3.631144,"scheduling_latency_s":3.63116} gitlab # [ 299.663320] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c4f01d52664d42d372bc09","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c4f01d52664d42d372bc09: done: 0.015805 sec","job_status":"done","queue_duration_s":3.631144,"scheduling_latency_s":3.63116,"redis_calls":13,"redis_duration_s":0.0015639999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015805,"completed_at":"2026-08-11T10:00:07.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.702323] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea527c48fba3c84384216bb","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea527c48fba3c84384216bb: start","job_status":"start","queue_duration_s":3.647993,"scheduling_latency_s":3.648008} gitlab # [ 299.714490] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea527c48fba3c84384216bb","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea527c48fba3c84384216bb: done: 0.015696 sec","job_status":"done","queue_duration_s":3.647993,"scheduling_latency_s":3.648008,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015696,"completed_at":"2026-08-11T10:00:07.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.753502] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a12a93202cb417a63fe25a59","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a12a93202cb417a63fe25a59: start","job_status":"start","queue_duration_s":3.664765,"scheduling_latency_s":3.664782} gitlab # [ 299.765908] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a12a93202cb417a63fe25a59","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a12a93202cb417a63fe25a59: done: 0.016063 sec","job_status":"done","queue_duration_s":3.664765,"scheduling_latency_s":3.664782,"redis_calls":13,"redis_duration_s":0.001364,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016063,"completed_at":"2026-08-11T10:00:07.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.804524] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bbd2e1645375e7c9832cc55","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bbd2e1645375e7c9832cc55: start","job_status":"start","queue_duration_s":3.682032,"scheduling_latency_s":3.682048} gitlab # [ 299.816815] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bbd2e1645375e7c9832cc55","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bbd2e1645375e7c9832cc55: done: 0.014951 sec","job_status":"done","queue_duration_s":3.682032,"scheduling_latency_s":3.682048,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014951,"completed_at":"2026-08-11T10:00:07.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.856871] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b92042a5b7545014645f8ea4","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b92042a5b7545014645f8ea4: start","job_status":"start","queue_duration_s":3.698045,"scheduling_latency_s":3.698061} gitlab # [ 299.869270] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b92042a5b7545014645f8ea4","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b92042a5b7545014645f8ea4: done: 0.015488 sec","job_status":"done","queue_duration_s":3.698045,"scheduling_latency_s":3.698061,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015488,"completed_at":"2026-08-11T10:00:07.935Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.908463] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339d4e471adffc9788624ae4","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339d4e471adffc9788624ae4: start","job_status":"start","queue_duration_s":3.714574,"scheduling_latency_s":3.71459} gitlab # [ 299.920447] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339d4e471adffc9788624ae4","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339d4e471adffc9788624ae4: done: 0.014749 sec","job_status":"done","queue_duration_s":3.714574,"scheduling_latency_s":3.71459,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014749,"completed_at":"2026-08-11T10:00:07.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 299.959443] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8a87d92b166f1324b689898","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8a87d92b166f1324b689898: start","job_status":"start","queue_duration_s":3.730343,"scheduling_latency_s":3.730359} gitlab # [ 299.972058] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8a87d92b166f1324b689898","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8a87d92b166f1324b689898: done: 0.016754 sec","job_status":"done","queue_duration_s":3.730343,"scheduling_latency_s":3.730359,"redis_calls":13,"redis_duration_s":0.0016029999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016754,"completed_at":"2026-08-11T10:00:07.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 300.012046] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d6cdabb9afc86efaff22b7a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d6cdabb9afc86efaff22b7a: start","job_status":"start","queue_duration_s":3.748158,"scheduling_latency_s":3.748174} gitlab # [ 300.024859] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d6cdabb9afc86efaff22b7a","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d6cdabb9afc86efaff22b7a: done: 0.014733 sec","job_status":"done","queue_duration_s":3.748158,"scheduling_latency_s":3.748174,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014733,"completed_at":"2026-08-11T10:00:07.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 300.065931] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:07.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c69acad547660da312294ed3","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c69acad547660da312294ed3: start","job_status":"start","queue_duration_s":3.763924,"scheduling_latency_s":3.76394} gitlab # [ 300.078345] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c69acad547660da312294ed3","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c69acad547660da312294ed3: done: 0.014999 sec","job_status":"done","queue_duration_s":3.763924,"scheduling_latency_s":3.76394,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014999,"completed_at":"2026-08-11T10:00:08.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 300.118239] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57993de032b0d528c71bbeee","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57993de032b0d528c71bbeee: start","job_status":"start","queue_duration_s":3.780014,"scheduling_latency_s":3.780031} gitlab # [ 300.130954] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57993de032b0d528c71bbeee","created_at":"2026-08-11T10:00:04.144Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-9e65537a7ba44ef1","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ca2c87ee7ef8cd7cfd72c64859f2c132","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:04.221Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57993de032b0d528c71bbeee: done: 0.014634 sec","job_status":"done","queue_duration_s":3.780014,"scheduling_latency_s":3.780031,"redis_calls":13,"redis_duration_s":0.0013440000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014634,"completed_at":"2026-08-11T10:00:08.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 300.171069] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.018Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"1f0fb79547addb03edec45cb","created_at":"2026-08-11T10:00:05.826Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-366875dbc61d4605","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"42fdbbedf4121474bc9aad09adc2c1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:05.838Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-1f0fb79547addb03edec45cb: start","job_status":"start","queue_duration_s":2.179723,"scheduling_latency_s":2.17974} gitlab # [ 300.186258] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.044Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"1f0fb79547addb03edec45cb","created_at":"2026-08-11T10:00:05.826Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-366875dbc61d4605","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"42fdbbedf4121474bc9aad09adc2c1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:05.838Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-1f0fb79547addb03edec45cb: done: 0.025605 sec","job_status":"done","queue_duration_s":2.179723,"scheduling_latency_s":2.17974,"redis_calls":10,"redis_duration_s":0.0012900000000000001,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023652,"duration_s":0.025605,"completed_at":"2026-08-11T10:00:08.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 300.229920] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.045Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"b59f8b8ba4cb0c113aa037ef","created_at":"2026-08-11T10:00:05.840Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-366875dbc61d4605","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"42fdbbedf4121474bc9aad09adc2c1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:05.846Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-b59f8b8ba4cb0c113aa037ef: start","job_status":"start","queue_duration_s":2.198509,"scheduling_latency_s":2.198525} gitlab # [ 300.245217] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:08.067Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"b59f8b8ba4cb0c113aa037ef","created_at":"2026-08-11T10:00:05.840Z","trace_propagation_headers":{"sentry-trace":"38ca1d907aa6497abc3491ac321c526d-366875dbc61d4605","baggage":"sentry-trace_id=38ca1d907aa6497abc3491ac321c526d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"42fdbbedf4121474bc9aad09adc2c1cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:05.846Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-b59f8b8ba4cb0c113aa037ef: done: 0.022165 sec","job_status":"done","queue_duration_s":2.198509,"scheduling_latency_s":2.198525,"redis_calls":10,"redis_duration_s":0.001366,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023066,"duration_s":0.022165,"completed_at":"2026-08-11T10:00:08.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.139566] redis[792]: 10 changes in 300 seconds. Saving... gitlab # [ 309.145335] redis[792]: Background saving started by pid 3317 gitlab # [ 309.154607] redis[3317]: BGSAVE done, 584 keys saved, 0 keys skipped, 143432 bytes written. gitlab # [ 309.159126] redis[3317]: DB saved on disk gitlab # [ 309.161459] redis[3317]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.240918] redis[792]: Background saving terminated with success gitlab # [ 310.840412] postgres[859]: [859] LOG: checkpoint starting: time gitlab # [ 311.839728] gitaly[909]: time="2026-08-11T10:00:23.739Z" level=info msg="burden monitor stats" pid=909 gitlab # [ 315.389876] postgres[3322]: [3322] ERROR: relation "table_without_models" does not exist gitlab # [ 315.390210] postgres[3322]: [3322] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 321.105440] runuser[2983]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 321.107097] setup-gitlab-start[2967]: + mkdir -p /var/lib/secrets gitlab # [ 321.111955] setup-gitlab-start[2967]: + echo nixbot-test-token-of-20-chars gitlab # [ 321.114791] setup-gitlab-start[2967]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 321.117898] setup-gitlab-start[2967]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 322.933355] gitaly[909]: time="2026-08-11T10:00:34.833Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:44.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:34.831" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.934686] gitaly[909]: time="2026-08-11T10:00:34.835Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:44.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:34.831" grpc.time_ms=1.651 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.196002] gitaly[909]: time="2026-08-11T10:00:35.097Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.096" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.258617] gitaly[909]: time="2026-08-11T10:00:35.097Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.096" grpc.time_ms=0.512 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.287718] gitaly[909]: time="2026-08-11T10:00:35.173Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ diskcache=ee1b81bc-0111-4b0d-8bf0-cda61d492e83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:00:45.017" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.108" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.309359] gitaly[909]: time="2026-08-11T10:00:35.174Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=36 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=40 command.spawn_token_fork_ms=4 command.system_time_ms=33 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:00:45.017" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.108" grpc.time_ms=65.572 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.330854] gitaly[909]: time="2026-08-11T10:00:35.197Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.196" pid=909 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 323.346387] gitaly[909]: time="2026-08-11T10:00:35.197Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.105" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.196" grpc.time_ms=1.543 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.361486] gitaly[909]: time="2026-08-11T10:00:35.223Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:45.114" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.205" grpc.time_ms=17.495 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.413415] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:35.312Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"458a6fbe621eb0a535efee11","created_at":"2026-08-11T10:00:35.243Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:35.308Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-458a6fbe621eb0a535efee11: start","job_status":"start","queue_duration_s":0.004575,"scheduling_latency_s":0.004633} gitlab # [ 323.456845] gitaly[909]: time="2026-08-11T10:00:35.339Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.249" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.339" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.490156] gitaly[909]: time="2026-08-11T10:00:35.339Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.249" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.339" grpc.time_ms=0.338 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.518967] gitaly[909]: time="2026-08-11T10:00:35.390Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ diskcache=83ea05cc-ae9b-4643-80f3-b40624f75535 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:00:45.254" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.344" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.544547] gitaly[909]: time="2026-08-11T10:00:35.390Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:00:45.254" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.344" grpc.time_ms=45.863 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.571563] gitaly[909]: time="2026-08-11T10:00:35.399Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.398" pid=909 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 323.587833] gitaly[909]: time="2026-08-11T10:00:35.399Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.398" grpc.time_ms=1.025 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.603595] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:35.451Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"458a6fbe621eb0a535efee11","created_at":"2026-08-11T10:00:35.243Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:35.308Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-458a6fbe621eb0a535efee11: done: 0.139272 sec","job_status":"done","queue_duration_s":0.004575,"scheduling_latency_s":0.004633,"redis_calls":13,"redis_duration_s":0.005809,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00107,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002949,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.1047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07201488,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.139272,"completed_at":"2026-08-11T10:00:35.451Z","load_balancing_strategy":"primary","db_duration_s":0.017434,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 323.658610] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:35.455Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e9f73ceffa03dfe88206c19e","created_at":"2026-08-11T10:00:35.325Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:35.332Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e9f73ceffa03dfe88206c19e: start","job_status":"start","queue_duration_s":0.122278,"scheduling_latency_s":0.122318} gitlab # [ 323.676260] gitaly[909]: time="2026-08-11T10:00:35.415Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:45.013" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.404" grpc.time_ms=11.035 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.692406] gitaly[909]: time="2026-08-11T10:00:35.459Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:45.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.459" grpc.time_ms=0.192 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.705189] gitaly[909]: time="2026-08-11T10:00:35.473Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:00:45.081" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:35.472" grpc.time_ms=0.458 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.716820] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:35.615Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e9f73ceffa03dfe88206c19e","created_at":"2026-08-11T10:00:35.325Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:35.332Z","job_size_bytes":2,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e9f73ceffa03dfe88206c19e: done: 0.160653 sec","job_status":"done","queue_duration_s":0.122278,"scheduling_latency_s":0.122318,"redis_calls":14,"redis_duration_s":0.005047,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001053,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002553,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001441,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11624002,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.160653,"completed_at":"2026-08-11T10:00:35.615Z","load_balancing_strategy":"primary","db_duration_s":0.02283,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 324.223757] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:36.124Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3a7da800d05e876e7e751980","created_at":"2026-08-11T10:00:36.110Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:36.122Z","job_size_bytes":5,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3a7da800d05e876e7e751980: start","job_status":"start","queue_duration_s":0.001772,"scheduling_latency_s":0.001813} gitlab # [ 324.417246] gitaly[909]: time="2026-08-11T10:00:36.317Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48GGJMJB1E1GWXYX1MKAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:46.209" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:36.300" grpc.time_ms=16.54 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 324.476683] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:36.376Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3a7da800d05e876e7e751980","created_at":"2026-08-11T10:00:36.110Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:36.122Z","job_size_bytes":5,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3a7da800d05e876e7e751980: done: 0.251875 sec","job_status":"done","queue_duration_s":0.001772,"scheduling_latency_s":0.001813,"redis_calls":12,"redis_duration_s":0.0050609999999999995,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001358,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002835,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066864,"duration_s":0.251875,"completed_at":"2026-08-11T10:00:36.376Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039142,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 324.565689] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:36.378Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"6761eb42001ffffeaba5c311","created_at":"2026-08-11T10:00:36.194Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:36.204Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-6761eb42001ffffeaba5c311: start","job_status":"start","queue_duration_s":0.1741,"scheduling_latency_s":0.174129} gitlab # [ 324.820277] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:36.718Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"6761eb42001ffffeaba5c311","created_at":"2026-08-11T10:00:36.194Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:36.204Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-6761eb42001ffffeaba5c311: done: 0.340295 sec","job_status":"done","queue_duration_s":0.1741,"scheduling_latency_s":0.174129,"redis_calls":11,"redis_duration_s":0.0035199999999999997,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000988,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":36,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.292,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.292,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.216512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004779,"duration_s":0.340295,"completed_at":"2026-08-11T10:00:36.718Z","load_balancing_strategy":"primary","db_duration_s":0.13028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 324.882289] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:36.720Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"09e64c2b52a25fc35792c48b","created_at":"2026-08-11T10:00:36.210Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:36.218Z","job_size_bytes":89,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-09e64c2b52a25fc35792c48b: start","job_status":"start","queue_duration_s":0.501903,"scheduling_latency_s":0.501925} gitlab # [ 324.900552] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:36.800Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"09e64c2b52a25fc35792c48b","created_at":"2026-08-11T10:00:36.210Z","trace_propagation_headers":{"sentry-trace":"ace088fce33545c0958657a1b3f86e0f-23862bfbedd24776","baggage":"sentry-trace_id=ace088fce33545c0958657a1b3f86e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48GGJMJB1E1GWXYX1MKAZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:36.218Z","job_size_bytes":89,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-09e64c2b52a25fc35792c48b: done: 0.079789 sec","job_status":"done","queue_duration_s":0.501903,"scheduling_latency_s":0.501925,"redis_calls":11,"redis_duration_s":0.002471,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000815,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029314,"duration_s":0.079789,"completed_at":"2026-08-11T10:00:36.800Z","load_balancing_strategy":"primary","db_duration_s":0.035407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 325.131062] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:37 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 3987 gitlab # [ 325.137820] setup-gitlab-start[2967]: + mkdir -p /tmp/test-flake gitlab # [ 325.140552] setup-gitlab-start[2967]: + cd /tmp/test-flake gitlab # [ 325.142819] setup-gitlab-start[2967]: + git init -b master gitlab # [ 325.161643] setup-gitlab-start[3424]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 325.165362] setup-gitlab-start[2967]: + git config user.name test gitlab # [ 325.169116] setup-gitlab-start[2967]: + git config user.email test@example.com gitlab # [ 325.174162] setup-gitlab-start[2967]: + cat gitlab # [ 325.179813] setup-gitlab-start[2967]: + git add flake.nix gitlab # [ 325.186345] setup-gitlab-start[2967]: + git commit -m 'initial commit' gitlab # [ 325.208473] setup-gitlab-start[3429]: [master (root-commit) 991c700] initial commit gitlab # [ 325.211520] setup-gitlab-start[3429]: 1 file changed, 10 insertions(+) gitlab # [ 325.214357] setup-gitlab-start[3429]: create mode 100644 flake.nix gitlab # [ 325.217049] setup-gitlab-start[2967]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 325.221883] setup-gitlab-start[2967]: + git push -u origin master gitlab # [ 325.349707] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 81 gitlab # [ 325.970160] gitaly[909]: time="2026-08-11T10:00:37.870Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR48MM44YYAWCXA9D7JFKQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:37.851" grpc.time_ms=18.801 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 325.970614] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 618 gitlab # [ 326.439348] gitaly[909]: time="2026-08-11T10:00:38.340Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:48.232" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:38.323" grpc.time_ms=16.617 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.525971] gitaly[909]: time="2026-08-11T10:00:38.427Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:01:08.008" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:00:38.408" grpc.time_ms=18.037 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.576345] gitaly[909]: time="2026-08-11T10:00:38.477Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR48N7YTPS2JY0909CXT4BP duration_ms=279ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 326.632568] gitaly[909]: time="2026-08-11T10:00:38.533Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR48N7YTPS2JY0909CXT4BP duration_ms=54ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 326.641430] gitaly[909]: time="2026-08-11T10:00:38.534Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:38.195" grpc.time_ms=338.478 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 326.677905] gitaly[909]: time="2026-08-11T10:00:38.578Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:38.576" grpc.time_ms=1.806 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 326.735167] gitaly[909]: time="2026-08-11T10:00:38.636Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:38.634" grpc.time_ms=1.157 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 326.788754] gitaly[909]: time="2026-08-11T10:00:38.689Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:38.688" grpc.time_ms=0.845 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 326.927581] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:38.826Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 991c700b2b15bfebffb92ab44a1270cba973f2e6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c9521e7476c03383f68a1e9e","created_at":"2026-08-11T10:00:38.813Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-87efebccaaee4961","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:38.824Z","job_size_bytes":185,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c9521e7476c03383f68a1e9e: start","job_status":"start","queue_duration_s":0.002402,"scheduling_latency_s":0.002459} gitlab # [ 326.977502] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:38.860Z","message":"changes: \"0000000000000000000000000000000000000000 991c700b2b15bfebffb92ab44a1270cba973f2e6 refs/heads/master\\n\""} gitlab # [ 326.984917] gitaly[909]: time="2026-08-11T10:00:38.878Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:48.045" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:38.866" grpc.time_ms=11.897 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.020406] gitaly[909]: time="2026-08-11T10:00:38.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:48.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:38.906" grpc.time_ms=14.493 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.056562] gitaly[909]: time="2026-08-11T10:00:38.930Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1431 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=9 command.system_time_ms=20 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:00:48.069" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:38.890" grpc.time_ms=39.303 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.086545] gitaly[909]: time="2026-08-11T10:00:38.954Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR48N7YTPS2JY0909CXT4BP duration_ms=208ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 327.092601] gitaly[909]: time="2026-08-11T10:00:38.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:38.744" grpc.time_ms=210.714 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.110323] gitaly[909]: time="2026-08-11T10:00:38.978Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP diskcache=fd56e493-5993-4223-a801-22cded6b7fd2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:38.070" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.125096] setup-gitlab-start[3433]: To http://gitlab/root/test-flake.git gitlab # [ 327.126310] setup-gitlab-start[3433]: * [new branch] master -> master gitlab # [ 327.127554] setup-gitlab-start[3433]: branch 'master' set up to track 'origin/master'. gitlab # [ 327.129577] gitlab-workhorse[818]: time="2026-08-11T10:00:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 327.132172] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:38 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1093 gitlab # [ 327.135078] systemd[1]: Finished setup-gitlab.service. gitlab # [ 327.136168] gitaly[909]: time="2026-08-11T10:00:38.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=374 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13422 command.oublock=32 command.real_time_ms=896 command.spawn_token_fork_ms=4 command.system_time_ms=220 command.user_time_ms=154 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:38.070" grpc.time_ms=908.793 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.152923] systemd[1]: Starting nixbot CI service... gitlab # [ 327.153827] gitaly[909]: time="2026-08-11T10:00:38.987Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=7 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:48.065" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:38.965" grpc.time_ms=21.975 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.169450] gitaly[909]: time="2026-08-11T10:00:39.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:00:49.010" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:39.041" grpc.time_ms=17.37 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.229314] gitaly[909]: time="2026-08-11T10:00:39.130Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:39.129" grpc.time_ms=0.536 pid=909 span.kind=server system=grpc gitlab # [ 327.263514] gitaly[909]: time="2026-08-11T10:00:39.164Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:39.163" grpc.time_ms=0.633 pid=909 span.kind=server system=grpc gitlab # [ 327.286516] gitaly[909]: time="2026-08-11T10:00:39.187Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP diskcache=6ea3f540-b6e4-4d67-8475-52b4557c1d2b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:00:49.047" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:39.077" pid=909 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 327.302650] gitaly[909]: time="2026-08-11T10:00:39.188Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=96 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4828 command.oublock=8 command.real_time_ms=103 command.spawn_token_fork_ms=1 command.system_time_ms=73 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:00:49.047" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:39.077" grpc.time_ms=109.9 pid=909 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 327.320590] gitaly[909]: time="2026-08-11T10:00:39.202Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:00:49.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:39.202" grpc.time_ms=0.125 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.333974] gitaly[909]: time="2026-08-11T10:00:39.219Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:00:49.176" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:39.207" grpc.time_ms=12.087 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: waiting for unit setup-gitlab.service, in 327.86 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 327.430603] gitaly[909]: time="2026-08-11T10:00:39.331Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-11T10:01:09.024" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:39.325" grpc.time_ms=6.611 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.475761] gitaly[909]: time="2026-08-11T10:00:39.376Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:00:49.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:39.376" grpc.time_ms=0.3 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.489582] gitaly[909]: time="2026-08-11T10:00:39.389Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:00:49.010" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:00:39.380" grpc.time_ms=8.914 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.518542] gitaly[909]: time="2026-08-11T10:00:39.419Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:49.041" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:39.411" grpc.time_ms=7.875 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.540212] gitaly[909]: time="2026-08-11T10:00:39.441Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:49.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:39.426" grpc.time_ms=15.052 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.580239] gitaly[909]: time="2026-08-11T10:00:39.481Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:01:09.161" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:39.461" grpc.time_ms=19.258 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.334820] gitaly[909]: time="2026-08-11T10:00:40.235Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:00:50.201" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.232" grpc.time_ms=2.849 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.393972] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 991c700b2b15bfebffb92ab44a1270cba973f2e6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c9521e7476c03383f68a1e9e","created_at":"2026-08-11T10:00:38.813Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-87efebccaaee4961","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:38.824Z","job_size_bytes":185,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c9521e7476c03383f68a1e9e: done: 1.466638 sec","job_status":"done","queue_duration_s":0.002402,"scheduling_latency_s":0.002459,"gitaly_calls":13,"gitaly_duration_s":0.299393,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.066383,"redis_read_bytes":1577,"redis_write_bytes":19078,"redis_cache_calls":15,"redis_cache_duration_s":0.004936,"redis_cache_read_bytes":20,"redis_cache_write_bytes":888,"redis_feature_flag_calls":29,"redis_feature_flag_duration_s":0.01086,"redis_feature_flag_read_bytes":1172,"redis_feature_flag_write_bytes":3542,"redis_queues_calls":8,"redis_queues_duration_s":0.001681,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4935,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003788,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.029686,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015432,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.579,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.616,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.08,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.86529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00104078,"exclusive_lock_hold_duration_s":0.05287274,"duration_s":1.466638,"completed_at":"2026-08-11T10:00:40.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.12597,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 328.492636] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.296Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"70fe2c525f4204a156b8b478","created_at":"2026-08-11T10:00:38.992Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:38.998Z","job_size_bytes":46,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-70fe2c525f4204a156b8b478: start","job_status":"start","queue_duration_s":1.29706,"scheduling_latency_s":1.297095} gitlab # [ 328.512002] gitaly[909]: time="2026-08-11T10:00:40.378Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-11T16:00:40.372" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:40.372" grpc.time_ms=5.056 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.525481] gitaly[909]: time="2026-08-11T10:00:40.407Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:01:10.088" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.388" grpc.time_ms=18.28 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.543564] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.444Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"70fe2c525f4204a156b8b478","created_at":"2026-08-11T10:00:38.992Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:38.998Z","job_size_bytes":46,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-70fe2c525f4204a156b8b478: done: 0.148199 sec","job_status":"done","queue_duration_s":1.29706,"scheduling_latency_s":1.297095,"gitaly_calls":2,"gitaly_duration_s":0.02867,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010298,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002012,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000813,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002089,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004306,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043818,"duration_s":0.148199,"completed_at":"2026-08-11T10:00:40.444Z","load_balancing_strategy":"primary","db_duration_s":0.023811,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 328.601020] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.446Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"916bc132329979d887c610bd","created_at":"2026-08-11T10:00:39.027Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:39.036Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-916bc132329979d887c610bd: start","job_status":"start","queue_duration_s":1.410052,"scheduling_latency_s":1.410075} gitlab # [ 328.620273] gitaly[909]: time="2026-08-11T10:00:40.503Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP diskcache=ab287e13-f3e5-4f75-a332-fc52a8c7ee0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:00:40.474" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.475" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.631315] gitaly[909]: time="2026-08-11T10:00:40.503Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:00:40.474" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.475" grpc.time_ms=28.221 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.653307] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.553Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"916bc132329979d887c610bd","created_at":"2026-08-11T10:00:39.027Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:39.036Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-916bc132329979d887c610bd: done: 0.107766 sec","job_status":"done","queue_duration_s":1.410052,"scheduling_latency_s":1.410075,"gitaly_calls":1,"gitaly_duration_s":0.030847,"redis_calls":15,"redis_duration_s":0.004366,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000819,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07910538,"duration_s":0.107766,"completed_at":"2026-08-11T10:00:40.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 328.704150] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.556Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"61416052feb3b85cab86636b","created_at":"2026-08-11T10:00:39.198Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:39.200Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-61416052feb3b85cab86636b: start","job_status":"start","queue_duration_s":1.355928,"scheduling_latency_s":1.355951} gitlab # [ 328.720091] gitaly[909]: time="2026-08-11T10:00:40.601Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:01:10.293" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.593" grpc.time_ms=8.234 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.733716] nixbot[3527]: {"ts": "2026-08-11T10:00:40.571Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 328.735849] nixbot[3527]: {"ts": "2026-08-11T10:00:40.610Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 328.737986] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.613Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"61416052feb3b85cab86636b","created_at":"2026-08-11T10:00:39.198Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:39.200Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-61416052feb3b85cab86636b: done: 0.057167 sec","job_status":"done","queue_duration_s":1.355928,"scheduling_latency_s":1.355951,"gitaly_calls":1,"gitaly_duration_s":0.010193,"redis_calls":16,"redis_duration_s":0.005692,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000385,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003102,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057167,"completed_at":"2026-08-11T10:00:40.613Z","load_balancing_strategy":"primary","db_duration_s":0.006921,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 328.784665] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:40.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1701d64895236cf45f42ece2","created_at":"2026-08-11T10:00:40.153Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0e1d87ecf138d4414c126511d2edcf1dd45106a38f223e259ce1d938cd461e9f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:40.163Z","job_size_bytes":467,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1701d64895236cf45f42ece2: start","job_status":"start","queue_duration_s":0.45504,"scheduling_latency_s":0.455062} gitlab # [ 328.802730] nixbot[3527]: {"ts": "2026-08-11T10:00:40.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 328.804913] nixbot[3527]: {"ts": "2026-08-11T10:00:40.662Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 328.807018] nixbot[3527]: {"ts": "2026-08-11T10:00:40.668Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 328.809326] nixbot[3527]: {"ts": "2026-08-11T10:00:40.678Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 328.811381] nixbot[3527]: {"ts": "2026-08-11T10:00:40.683Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 328.813659] nixbot[3527]: {"ts": "2026-08-11T10:00:40.685Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 328.815645] nixbot[3527]: {"ts": "2026-08-11T10:00:40.694Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 328.817872] nixbot[3527]: {"ts": "2026-08-11T10:00:40.697Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 328.819901] nixbot[3527]: {"ts": "2026-08-11T10:00:40.703Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 328.822151] gitaly[909]: time="2026-08-11T10:00:40.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:10.364" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.665" grpc.time_ms=0.72 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.835520] nixbot[3527]: {"ts": "2026-08-11T10:00:40.711Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 328.837811] nixbot[3527]: {"ts": "2026-08-11T10:00:40.715Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 328.839960] nixbot[3527]: {"ts": "2026-08-11T10:00:40.718Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 328.842400] nixbot[3527]: {"ts": "2026-08-11T10:00:40.723Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 328.844755] nixbot[3527]: {"ts": "2026-08-11T10:00:40.725Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 328.846899] nixbot[3527]: {"ts": "2026-08-11T10:00:40.727Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 328.849203] nixbot[3527]: {"ts": "2026-08-11T10:00:40.728Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 328.851205] nixbot[3527]: {"ts": "2026-08-11T10:00:40.733Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 328.853369] nixbot[3527]: {"ts": "2026-08-11T10:00:40.735Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 328.855491] gitaly[909]: time="2026-08-11T10:00:40.676Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:00:50.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:40.669" grpc.time_ms=7.688 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.871285] nixbot[3527]: {"ts": "2026-08-11T10:00:40.737Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 328.874934] nixbot[3527]: {"ts": "2026-08-11T10:00:40.742Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 328.882576] nixbot[3527]: {"ts": "2026-08-11T10:00:40.744Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 328.884794] nixbot[3527]: {"ts": "2026-08-11T10:00:40.746Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 328.886799] nixbot[3527]: {"ts": "2026-08-11T10:00:40.747Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 328.913150] gitaly[909]: time="2026-08-11T10:00:40.814Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:10.511" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.811" grpc.time_ms=1.919 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.929234] gitaly[909]: time="2026-08-11T10:00:40.823Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=130 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:01:10.517" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:40.818" grpc.time_ms=4.49 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.060550] gitaly[909]: time="2026-08-11T10:00:40.961Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:50.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:40.947" grpc.time_ms=14.133 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.261262] nixbot[3527]: INFO: Started server process [3527] gitlab # [ 329.263986] nixbot[3527]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 329.286069] nixbot[3527]: INFO: ::ffff:127.0.0.1:55590 - "GET /health HTTP/1.1" 200 OK gitlab # [ 329.296765] systemd[1]: Started nixbot CI service. gitlab # [ 329.299233] systemd[1]: Reached target Multi-User System. gitlab # [ 329.301765] systemd[1]: Startup finished in 745ms (kernel) + 4.134s (initrd) + 5min 24.419s (userspace) = 5min 29.299s. gitlab: (finished: waiting for unit nixbot.service, in 2.16 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 329.586106] gitaly[909]: time="2026-08-11T10:00:41.485Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=884 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=4 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48RF1941QSK6WECRAV8XW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:01:11.053" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:41.454" grpc.time_ms=31.47 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.629229] nixbot[3527]: INFO: ::ffff:127.0.0.1:55606 - "GET /health HTTP/1.1" 200 OK gitlab # [ 329.677341] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:41 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 390 gitlab # [ 329.684583] nixbot[3527]: {"ts": "2026-08-11T10:00:41.577Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 329.703128] nixbot[3527]: {"ts": "2026-08-11T10:00:41.604Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 329.767571] gitaly[909]: time="2026-08-11T10:00:41.668Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:01:11.352" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:41.653" grpc.time_ms=15.33 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.790637] gitaly[909]: time="2026-08-11T10:00:41.691Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=13 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48N7YTPS2JY0909CXT4BP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:01:11.371" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:41.672" grpc.time_ms=19.695 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.823892] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 108 gitlab # [ 329.826604] nixbot[3527]: {"ts": "2026-08-11T10:00:41.722Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 329.828988] nixbot[3527]: {"ts": "2026-08-11T10:00:41.723Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 329.838186] sidekiq-cluster[2024]: {"severity":"WARN","time":"2026-08-11T10:00:41.738Z","class":"CreatePipelineWorker","correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"991c700b2b15bfebffb92ab44a1270cba973f2e6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"991c700b2b15bfebffb92ab44a1270cba973f2e6","ref":"refs/heads/master"},"retry":0} gitlab # [ 329.847798] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:41.748Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1701d64895236cf45f42ece2","created_at":"2026-08-11T10:00:40.153Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-d2ba7f09b6ab4dff","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0e1d87ecf138d4414c126511d2edcf1dd45106a38f223e259ce1d938cd461e9f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:40.163Z","job_size_bytes":467,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1701d64895236cf45f42ece2: done: 1.129732 sec","job_status":"done","queue_duration_s":0.45504,"scheduling_latency_s":0.455062,"gitaly_calls":7,"gitaly_duration_s":0.084457,"redis_calls":51,"redis_duration_s":0.013379,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001059,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005178,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004375,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.946319,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051644,"duration_s":1.129732,"completed_at":"2026-08-11T10:00:41.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093191,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.31 seconds) gitlab # [ 329.899826] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:41.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"84c9137191ccd107dfe89609","created_at":"2026-08-11T10:00:40.420Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-3fd2fd0cbe974ee1","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:40.426Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-84c9137191ccd107dfe89609: start","job_status":"start","queue_duration_s":1.323295,"scheduling_latency_s":1.323318} gitlab # [ 329.916236] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 227 gitlab # [ 329.919314] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:41.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"84c9137191ccd107dfe89609","created_at":"2026-08-11T10:00:40.420Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-3fd2fd0cbe974ee1","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:40.426Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-84c9137191ccd107dfe89609: done: 0.064684 sec","job_status":"done","queue_duration_s":1.323295,"scheduling_latency_s":1.323318,"redis_calls":19,"redis_duration_s":0.004985,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000724,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000696,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002636,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00861842,"duration_s":0.064684,"completed_at":"2026-08-11T10:00:41.814Z","load_balancing_strategy":"primary","db_duration_s":0.012782,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 329.965518] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:41.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"27d57edd15c1f27d419fa694","created_at":"2026-08-11T10:00:41.792Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-1dd3de2487fc4eee","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:41.798Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-27d57edd15c1f27d419fa694: start","job_status":"start","queue_duration_s":0.018273,"scheduling_latency_s":0.018297} gitlab # [ 330.003088] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 177 gitlab # [ 330.005399] nixbot[3527]: {"ts": "2026-08-11T10:00:41.906Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 330.023283] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:41.924Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"27d57edd15c1f27d419fa694","created_at":"2026-08-11T10:00:41.792Z","trace_propagation_headers":{"sentry-trace":"3d94f38c56e040cf9d8f249d4e8c214c-1dd3de2487fc4eee","baggage":"sentry-trace_id=3d94f38c56e040cf9d8f249d4e8c214c,sentry-release=Unknown"},"correlation_id":"01KZR48N7YTPS2JY0909CXT4BP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:41.798Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-27d57edd15c1f27d419fa694: done: 0.107621 sec","job_status":"done","queue_duration_s":0.018273,"scheduling_latency_s":0.018297,"redis_calls":11,"redis_duration_s":0.001984,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020498,"duration_s":0.107621,"completed_at":"2026-08-11T10:00:41.923Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 330.172419] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:42 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 152 gitlab # [ 330.179606] nixbot[3527]: {"ts": "2026-08-11T10:00:42.075Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 330.253987] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 65 gitlab # [ 330.260395] nixbot[3527]: {"ts": "2026-08-11T10:00:42.156Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 330.397997] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:42 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 134 gitlab # [ 330.402595] nixbot[3527]: {"ts": "2026-08-11T10:00:42.300Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 330.511516] gitaly[909]: time="2026-08-11T10:00:42.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48SJ887DZ7EP9ZQ0SV5RF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-11T10:01:12.091" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:42.392" grpc.time_ms=19.021 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 330.559714] gitaly[909]: time="2026-08-11T10:00:42.433Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48SJ887DZ7EP9ZQ0SV5RF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:12.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:42.431" grpc.time_ms=1.076 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 330.596748] gitaly[909]: time="2026-08-11T10:00:42.457Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48SJ887DZ7EP9ZQ0SV5RF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T10:00:52.049" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:42.440" grpc.time_ms=17.034 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 330.685110] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 272 gitlab # [ 330.692255] nixbot[3527]: {"ts": "2026-08-11T10:00:42.586Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 330.901537] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 207 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 330.906643] nixbot[3527]: {"ts": "2026-08-11T10:00:42.804Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 330.911943] nixbot[3527]: {"ts": "2026-08-11T10:00:42.812Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds) gitlab # [ 331.084142] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 122 (finished: subtest: project discovered and webhook registered, in 1.50 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 331.110909] gitaly[909]: time="2026-08-11T10:00:43.012Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48T4K4N113FVPPKX6WNTP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:42.991" grpc.time_ms=20.668 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.150678] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 114 gitlab # [ 331.220204] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 57 gitlab # [ 331.461018] gitaly[909]: time="2026-08-11T10:00:43.362Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48T8AN5CQZZK2HS013SPX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.343" pid=909 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=149 span.kind=server system=grpc gitlab # [ 331.491225] gitaly[909]: time="2026-08-11T10:00:43.362Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48T8AN5CQZZK2HS013SPX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.343" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.519308] gitlab-workhorse[818]: time="2026-08-11T10:00:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=149 gitlab # [ 331.522636] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.55.0" 344 gitlab # [ 331.526069] gitaly[909]: time="2026-08-11T10:00:43.362Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48T8AN5CQZZK2HS013SPX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.343" grpc.time_ms=19.395 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.573664] gitaly[909]: time="2026-08-11T10:00:43.474Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TBJYV5523JPZ85YQ23C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.464" grpc.time_ms=9.961 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)[ 331.609001] gitaly[909]: time="2026-08-11T10:00:43.487Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TK7S5Y7HQ6B3NJE0401 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.462" pid=909 remote_ip="2001:db8:1::1" request_sha=2471f8984a68433475b130aa8e2cc4438ef9905b response_bytes=228 span.kind=server system=grpc gitlab # Counting objects: 60% (3/5)[ 331.630535] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 353 gitlab # Counting objects: 80% (4/5)[ 331.634482] gitlab-workhorse[818]: time="2026-08-11T10:00:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=228 gitlab # Counting objects: 100% (5/5)[ 331.637975] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 228 "" "git/2.55.0" 120 gitlab # Counting objects: 100% (5/5), done. gitlab # [ 331.641402] gitaly[909]: time="2026-08-11T10:00:43.487Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TK7S5Y7HQ6B3NJE0401 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.462" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=2 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # Delta compression using up to 4 threads[ 331.660603] gitaly[909]: time="2026-08-11T10:00:43.487Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TK7S5Y7HQ6B3NJE0401 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.462" grpc.time_ms=24.65 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=2 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)[ 331.680528] gitaly[909]: time="2026-08-11T10:00:43.581Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TR0YWBYVMT3AN4K5ED4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.564" grpc.time_ms=17.15 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.695224] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 15.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 331.769189] gitaly[909]: time="2026-08-11T10:00:43.670Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TT5C24WQV4RFAJNANXP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.657" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 331.795241] gitaly[909]: time="2026-08-11T10:00:43.670Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TT5C24WQV4RFAJNANXP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.657" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.823844] gitlab-workhorse[818]: time="2026-08-11T10:00:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 331.827693] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 81 gitlab # [ 331.831262] gitaly[909]: time="2026-08-11T10:00:43.672Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TT5C24WQV4RFAJNANXP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.657" grpc.time_ms=13.001 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.875890] gitaly[909]: time="2026-08-11T10:00:43.777Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TXYV66MWPFNGT6M6BDP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.766" grpc.time_ms=10.115 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 331.900409] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 67 gitlab # [ 331.958698] gitaly[909]: time="2026-08-11T10:00:43.859Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V034XF3BMFK8PCVJRQX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.838" pid=909 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 331.970163] gitaly[909]: time="2026-08-11T10:00:43.859Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V034XF3BMFK8PCVJRQX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.838" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 332.006681] gitlab-workhorse[818]: time="2026-08-11T10:00:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 332.010959] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 80 gitlab # [ 332.015170] gitaly[909]: time="2026-08-11T10:00:43.859Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V034XF3BMFK8PCVJRQX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.838" grpc.time_ms=21.417 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 332.040509] gitaly[909]: time="2026-08-11T10:00:43.870Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T10:00:53.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:43.853" grpc.time_ms=16.121 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.058434] gitaly[909]: time="2026-08-11T10:00:43.950Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:01:13.039" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:00:43.939" grpc.time_ms=11.095 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.075016] gitaly[909]: time="2026-08-11T10:00:43.973Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:13.572" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:43.973" grpc.time_ms=0.421 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.088420] gitaly[909]: time="2026-08-11T10:00:43.975Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 duration_ms=232ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 332.106380] gitaly[909]: time="2026-08-11T10:00:44.007Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 duration_ms=32ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 332.110166] gitaly[909]: time="2026-08-11T10:00:44.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:43.742" grpc.time_ms=265.717 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.122629] gitaly[909]: time="2026-08-11T10:00:44.009Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=588 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:01:13.600" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:44.000" grpc.time_ms=9.468 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.139834] gitaly[909]: time="2026-08-11T10:00:44.033Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:54.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:44.018" grpc.time_ms=8.66 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.156178] gitaly[909]: time="2026-08-11T10:00:44.038Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:44.036" grpc.time_ms=0.544 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.178347] gitaly[909]: time="2026-08-11T10:00:44.079Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:44.079" grpc.time_ms=0.375 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.192442] gitaly[909]: time="2026-08-11T10:00:44.088Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:00:54.077" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:44.087" grpc.time_ms=0.612 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.204354] gitaly[909]: time="2026-08-11T10:00:44.103Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:00:54.086" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:44.096" grpc.time_ms=7.164 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.221728] gitaly[909]: time="2026-08-11T10:00:44.122Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:44.122" grpc.time_ms=0.661 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.239776] gitaly[909]: time="2026-08-11T10:00:44.140Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:44.139" grpc.time_ms=0.857 pid=909 span.kind=server system=grpc gitlab # [ 332.262069] gitaly[909]: time="2026-08-11T10:00:44.163Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:44.162" grpc.time_ms=0.264 pid=909 span.kind=server system=grpc gitlab # [ 332.276284] gitaly[909]: time="2026-08-11T10:00:44.177Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 diskcache=c4d9c9d0-620c-4f87-afe1-d49824dbfab7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:00:54.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:44.105" pid=909 ref=refs/keep-around/991c700b2b15bfebffb92ab44a1270cba973f2e6 remote_ip="2001:db8:1::1" revision=991c700b2b15bfebffb92ab44a1270cba973f2e6 span.kind=server system=grpc username=root gitlab # [ 332.287873] gitaly[909]: time="2026-08-11T10:00:44.178Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5105 command.oublock=8 command.real_time_ms=67 command.spawn_token_fork_ms=2 command.system_time_ms=28 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:00:54.095" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:44.105" grpc.time_ms=72.504 pid=909 ref=refs/keep-around/991c700b2b15bfebffb92ab44a1270cba973f2e6 remote_ip="2001:db8:1::1" revision=991c700b2b15bfebffb92ab44a1270cba973f2e6 span.kind=server system=grpc username=root gitlab # [ 332.303092] gitaly[909]: time="2026-08-11T10:00:44.182Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:14.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:44.181" grpc.time_ms=0.554 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.317226] gitaly[909]: time="2026-08-11T10:00:44.218Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 duration_ms=63ns method=POST pid=909 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 332.320231] gitaly[909]: time="2026-08-11T10:00:44.218Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:44.154" grpc.time_ms=64.108 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 332.331278] gitaly[909]: time="2026-08-11T10:00:44.228Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 diskcache=aa820951-a0f4-413a-8b94-aa09941d5208 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.686" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # 991c700..7f3c80a [ 332.342182] gitlab-workhorse[818]: time="2026-08-11T10:00:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 332.344207] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:44 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 626 gitlab # gitlab # [ 332.346188] gitaly[909]: time="2026-08-11T10:00:44.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=147 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13209 command.oublock=32 command.real_time_ms=536 command.spawn_token_fork_ms=3 command.system_time_ms=87 command.user_time_ms=60 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:43.686" grpc.time_ms=542.286 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.28 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 332.360000] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:44.258Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2125f69ae9d137fce5aad2ee","created_at":"2026-08-11T10:00:44.186Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-fc1b7ad993ab42c0","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.193Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2125f69ae9d137fce5aad2ee: start","job_status":"start","queue_duration_s":0.065727,"scheduling_latency_s":0.065757} gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53', in 0.07 seconds) gitlab # [ 332.455623] nixbot[3527]: INFO: ::ffff:127.0.0.1:43624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 200 OK gitlab # [ 332.478776] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/991c700b2b15bfebffb92ab44a1270cba973f2e6 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 476 gitlab # [ 332.481925] nixbot[3527]: {"ts": "2026-08-11T10:00:44.380Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/991c700b2b15bfebffb92ab44a1270cba973f2e6 \"HTTP/1.1 201 Created\""} gitlab # [ 332.489280] nixbot[3527]: {"ts": "2026-08-11T10:00:44.390Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-991c700b2b15-0"} gitlab # [ 332.512773] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:44.413Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2125f69ae9d137fce5aad2ee","created_at":"2026-08-11T10:00:44.186Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-fc1b7ad993ab42c0","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.193Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2125f69ae9d137fce5aad2ee: done: 0.154613 sec","job_status":"done","queue_duration_s":0.065727,"scheduling_latency_s":0.065757,"redis_calls":17,"redis_duration_s":0.025387,"redis_read_bytes":273,"redis_write_bytes":1854,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.016639,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00524,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003508,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00098942,"duration_s":0.154613,"completed_at":"2026-08-11T10:00:44.413Z","load_balancing_strategy":"primary","db_duration_s":0.048576,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 332.558777] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:44.421Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","991c700b2b15bfebffb92ab44a1270cba973f2e6 7f3c80af95af72a8d0871ce61310ae60630dae53 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0b8bd7b7626e08f43cdd2b71","created_at":"2026-08-11T10:00:44.194Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-cb720e79c3f24f86","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.198Z","job_size_bytes":185,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0b8bd7b7626e08f43cdd2b71: start","job_status":"start","queue_duration_s":0.223303,"scheduling_latency_s":0.223334} gitlab # [ 332.578130] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:44.449Z","message":"changes: \"991c700b2b15bfebffb92ab44a1270cba973f2e6 7f3c80af95af72a8d0871ce61310ae60630dae53 refs/heads/master\\n\""} gitlab # [ 332.583489] systemd[1]: Started Nix Daemon. gitlab # [ 332.584733] gitaly[909]: time="2026-08-11T10:00:44.484Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:54.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:44.473" grpc.time_ms=10.332 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.632547] gitaly[909]: time="2026-08-11T10:00:44.532Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:00:54.151" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:44.522" grpc.time_ms=10.6 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.657884] nix-daemon[3806]: accepted connection from pid 3799, user nixbot gitlab # [ 332.669128] gitaly[909]: time="2026-08-11T10:00:44.570Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:00:54.192" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:44.562" grpc.time_ms=7.679 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.746225] nix-daemon[3806]: accepted connection from pid 3818, user nixbot gitlab # [ 332.767129] nixbot[3527]: {"ts": "2026-08-11T10:00:44.668Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-991c700b2b15-0", "argv0": "bwrap"} gitlab # [ 332.791874] gitaly[909]: time="2026-08-11T10:00:44.693Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-11T10:01:14.375" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:44.675" grpc.time_ms=17.326 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.831714] gitaly[909]: time="2026-08-11T10:00:44.720Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:00:54.050" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:00:44.710" grpc.time_ms=9.838 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.857025] gitaly[909]: time="2026-08-11T10:00:44.748Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:54.077" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:44.738" grpc.time_ms=10.678 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.970922] nix-daemon[3806]: accepted connection from pid 3833, user nixbot gitlab # [ 333.043347] nix-daemon[3806]: accepted connection from pid 3844, user nixbot gitlab # [ 333.066761] nix-daemon[3806]: accepted connection from pid 3833, user nixbot gitlab # [ 333.400687] gitaly[909]: time="2026-08-11T10:00:45.301Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:00:55.265" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:45.296" grpc.time_ms=5.51 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53', in 0.07 seconds) gitlab # [ 333.516088] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:45.414Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","991c700b2b15bfebffb92ab44a1270cba973f2e6 7f3c80af95af72a8d0871ce61310ae60630dae53 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0b8bd7b7626e08f43cdd2b71","created_at":"2026-08-11T10:00:44.194Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-cb720e79c3f24f86","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.198Z","job_size_bytes":185,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0b8bd7b7626e08f43cdd2b71: done: 0.992833 sec","job_status":"done","queue_duration_s":0.223303,"scheduling_latency_s":0.223334,"gitaly_calls":7,"gitaly_duration_s":0.244058,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.114509,"redis_read_bytes":350,"redis_write_bytes":13068,"redis_cache_calls":9,"redis_cache_duration_s":0.018618,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004086,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.006399,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6768,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.011467,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.01753,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.056409,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.161,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.095,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.095,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.161,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.404027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00076066,"exclusive_lock_hold_duration_s":0.05338266,"duration_s":0.992833,"completed_at":"2026-08-11T10:00:45.414Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.189615,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 333.611759] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:45.425Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8aa19652e319264bcda6dfea","created_at":"2026-08-11T10:00:44.193Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-fc1b7ad993ab42c0","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.198Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8aa19652e319264bcda6dfea: start","job_status":"start","queue_duration_s":1.226874,"scheduling_latency_s":1.226932} gitlab # [ 333.631633] nixbot[3527]: INFO: ::ffff:127.0.0.1:43628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 200 OK gitlab # [ 333.818314] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:45.718Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8aa19652e319264bcda6dfea","created_at":"2026-08-11T10:00:44.193Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-fc1b7ad993ab42c0","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.198Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8aa19652e319264bcda6dfea: done: 0.292515 sec","job_status":"done","queue_duration_s":1.226874,"scheduling_latency_s":1.226932,"redis_calls":21,"redis_duration_s":0.0431,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.021577,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010384,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.011139,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.14647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096962,"duration_s":0.292515,"completed_at":"2026-08-11T10:00:45.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 333.922659] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:45.721Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"913995042ab63554eab49afd","created_at":"2026-08-11T10:00:44.351Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-fc1b7ad993ab42c0","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.357Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-913995042ab63554eab49afd: start","job_status":"start","queue_duration_s":1.364455,"scheduling_latency_s":1.364499} gitlab # [ 334.150556] gitaly[909]: time="2026-08-11T10:00:46.051Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:16.048" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.049" grpc.time_ms=1.731 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.259112] gitaly[909]: time="2026-08-11T10:00:46.160Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48V3Z89AJNWPNCB25B2Z5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:16.157" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.158" grpc.time_ms=1.589 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.298457] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:46.196Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"913995042ab63554eab49afd","created_at":"2026-08-11T10:00:44.351Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-fc1b7ad993ab42c0","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.357Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-913995042ab63554eab49afd: done: 0.474286 sec","job_status":"done","queue_duration_s":1.364455,"scheduling_latency_s":1.364499,"gitaly_calls":2,"gitaly_duration_s":0.014803,"redis_calls":46,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016999,"redis_read_bytes":328,"redis_write_bytes":6707,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001565,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002132,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_feature_flag_calls":12,"redis_feature_flag_duration_s":0.005148,"redis_feature_flag_read_bytes":266,"redis_feature_flag_write_bytes":1627,"redis_queues_calls":2,"redis_queues_duration_s":0.000417,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002907,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":3,"redis_rate_limiting_duration_s":0.000987,"redis_rate_limiting_read_bytes":6,"redis_rate_limiting_write_bytes":170,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000471,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":32,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":32,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.391239,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.36963431999999996,"duration_s":0.474286,"completed_at":"2026-08-11T10:00:46.195Z","load_balancing_strategy":"primary","db_duration_s":0.06419,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 334.394072] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:46.199Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"47ea76c50d07d0e40bc6c781","created_at":"2026-08-11T10:00:44.536Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.541Z","job_size_bytes":46,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-47ea76c50d07d0e40bc6c781: start","job_status":"start","queue_duration_s":1.658424,"scheduling_latency_s":1.658463} gitlab # [ 334.411107] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:46.249Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"47ea76c50d07d0e40bc6c781","created_at":"2026-08-11T10:00:44.536Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.541Z","job_size_bytes":46,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-47ea76c50d07d0e40bc6c781: done: 0.049566 sec","job_status":"done","queue_duration_s":1.658424,"scheduling_latency_s":1.658463,"redis_calls":11,"redis_duration_s":0.004523,"redis_read_bytes":25,"redis_write_bytes":1047,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000766,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":265,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000437,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049566,"completed_at":"2026-08-11T10:00:46.248Z","load_balancing_strategy":"primary","db_duration_s":0.004269,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 334.456862] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:46.253Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"78d0386eec499f700dd050f7","created_at":"2026-08-11T10:00:44.550Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.556Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-78d0386eec499f700dd050f7: start","job_status":"start","queue_duration_s":1.696937,"scheduling_latency_s":1.696985} gitlab # [ 334.474500] gitaly[909]: time="2026-08-11T10:00:46.348Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 diskcache=09dd0385-9510-4584-9ef5-c30924f4b0c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:00:46.295" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.296" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.484257] gitaly[909]: time="2026-08-11T10:00:46.349Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=36 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1508 command.oublock=0 command.real_time_ms=70 command.spawn_token_fork_ms=5 command.system_time_ms=23 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:00:46.295" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.296" grpc.time_ms=52.875 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53' gitlab # [ 334.499117] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:46.383Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"78d0386eec499f700dd050f7","created_at":"2026-08-11T10:00:44.550Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:44.556Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-78d0386eec499f700dd050f7: done: 0.130441 sec","job_status":"done","queue_duration_s":1.696937,"scheduling_latency_s":1.696985,"gitaly_calls":1,"gitaly_duration_s":0.057208,"redis_calls":12,"redis_duration_s":0.004803,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001227,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08920714,"duration_s":0.130441,"completed_at":"2026-08-11T10:00:46.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.543021] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:46.386Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"dcf2c7f8bf23c5252a0193d0","created_at":"2026-08-11T10:00:45.000Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b7d23c2ba7671d592fd7c9aa2f80e95888a2433c41a74b53800d64ad6b10a0e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:45.008Z","job_size_bytes":467,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-dcf2c7f8bf23c5252a0193d0: start","job_status":"start","queue_duration_s":1.378204,"scheduling_latency_s":1.378234} gitlab # [ 334.560318] gitaly[909]: time="2026-08-11T10:00:46.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:16.421" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.422" grpc.time_ms=0.897 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.572332] gitaly[909]: time="2026-08-11T10:00:46.444Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:00:56.056" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:46.427" grpc.time_ms=16.794 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53', in 0.07 seconds) gitlab # [ 334.585110] nixbot[3527]: INFO: ::ffff:127.0.0.1:43644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 200 OK gitlab # [ 334.616672] gitaly[909]: time="2026-08-11T10:00:46.517Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:16.515" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.516" grpc.time_ms=1.398 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.632251] gitaly[909]: time="2026-08-11T10:00:46.530Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=37 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:01:16.525" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:46.526" grpc.time_ms=4.223 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.702859] gitaly[909]: time="2026-08-11T10:00:46.603Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:56.217" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:46.587" grpc.time_ms=16.308 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.259817] gitaly[909]: time="2026-08-11T10:00:47.160Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:01:17.131" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:47.132" grpc.time_ms=27.878 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.290873] gitaly[909]: time="2026-08-11T10:00:47.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR48TTJJKSTHK8PE2Q1SJF1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:01:17.165" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:47.166" grpc.time_ms=25.822 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.319946] sidekiq-cluster[2024]: {"severity":"WARN","time":"2026-08-11T10:00:47.220Z","class":"CreatePipelineWorker","correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"991c700b2b15bfebffb92ab44a1270cba973f2e6","after":"7f3c80af95af72a8d0871ce61310ae60630dae53","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"7f3c80af95af72a8d0871ce61310ae60630dae53","ref":"refs/heads/master"},"retry":0} gitlab # [ 335.341750] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.241Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"dcf2c7f8bf23c5252a0193d0","created_at":"2026-08-11T10:00:45.000Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b7d23c2ba7671d592fd7c9aa2f80e95888a2433c41a74b53800d64ad6b10a0e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:45.008Z","job_size_bytes":467,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-dcf2c7f8bf23c5252a0193d0: done: 0.855342 sec","job_status":"done","queue_duration_s":1.378204,"scheduling_latency_s":1.378234,"gitaly_calls":7,"gitaly_duration_s":0.121026,"redis_calls":33,"redis_duration_s":0.011883999999999999,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001095,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004042,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003085,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.702372,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.855342,"completed_at":"2026-08-11T10:00:47.241Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036037,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 335.402272] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.247Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"cf910f2d-ef59-47db-8a84-18e772f95962\"}"],"class":"WebHookWorker","jid":"d1181e9cb8c0380f59af92a3","created_at":"2026-08-11T10:00:45.235Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d06707d93e544a8f8a33a99bf0ded4040e269ec4963f41d7d9ad0cc90bc2c12a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:45.254Z","job_size_bytes":1749,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d1181e9cb8c0380f59af92a3: start","job_status":"start","queue_duration_s":1.992705,"scheduling_latency_s":1.992756} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53', in 0.06 seconds) gitlab # [ 335.644712] nixbot[3527]: INFO: ::ffff:127.0.0.1:43660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 200 OK gitlab # [ 335.730691] nixbot[3527]: INFO: ::ffff:127.0.0.1:43670 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 335.771754] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.670Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"cf910f2d-ef59-47db-8a84-18e772f95962\"}"],"class":"WebHookWorker","jid":"d1181e9cb8c0380f59af92a3","created_at":"2026-08-11T10:00:45.235Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-ccb530cec7704d99","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d06707d93e544a8f8a33a99bf0ded4040e269ec4963f41d7d9ad0cc90bc2c12a","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:45.254Z","job_size_bytes":1749,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d1181e9cb8c0380f59af92a3: done: 0.423187 sec","job_status":"done","queue_duration_s":1.992705,"scheduling_latency_s":1.992756,"redis_calls":19,"redis_duration_s":0.0075,"redis_read_bytes":31,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001904,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000566,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003496,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001534,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08613048000000845,"cpu_s":0.23473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085998,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.423187,"completed_at":"2026-08-11T10:00:47.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.858658] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f5981072b41414105c472cfa","created_at":"2026-08-11T10:00:45.996Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-e96b79f74b4d43c7","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:46.007Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f5981072b41414105c472cfa: start","job_status":"start","queue_duration_s":1.667712,"scheduling_latency_s":1.667763} gitlab # [ 335.876388] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f5981072b41414105c472cfa","created_at":"2026-08-11T10:00:45.996Z","trace_propagation_headers":{"sentry-trace":"999aa96b744848cc89b5abfab763cc52-e96b79f74b4d43c7","baggage":"sentry-trace_id=999aa96b744848cc89b5abfab763cc52,sentry-release=Unknown"},"correlation_id":"01KZR48V3Z89AJNWPNCB25B2Z5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:46.007Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f5981072b41414105c472cfa: done: 0.098561 sec","job_status":"done","queue_duration_s":1.667712,"scheduling_latency_s":1.667763,"redis_calls":10,"redis_duration_s":0.004198,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000649,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095184,"duration_s":0.098561,"completed_at":"2026-08-11T10:00:47.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.921345] gitaly[909]: time="2026-08-11T10:00:47.817Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48YT71WZ4M8DC5KE62168 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:47.797" grpc.time_ms=20.285 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 335.934617] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 130 gitlab # [ 335.936735] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.778Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d1181e9cb8c0380f59af92a3"],"class":"WebHooks::LogExecutionWorker","jid":"6a864a4b89d14caedc9b9f48","created_at":"2026-08-11T10:00:47.635Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-debbef4858334d7e","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdbb0a75514ec6637f2e747b0393fd13cbdf5bd76519f6053807fb1cf3051bc8","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:47.649Z","job_size_bytes":2591,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6a864a4b89d14caedc9b9f48: start","job_status":"start","queue_duration_s":0.12858,"scheduling_latency_s":0.128625} gitlab # [ 335.969971] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:47.870Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d1181e9cb8c0380f59af92a3"],"class":"WebHooks::LogExecutionWorker","jid":"6a864a4b89d14caedc9b9f48","created_at":"2026-08-11T10:00:47.635Z","trace_propagation_headers":{"sentry-trace":"3b6fde82574f43fa849216f6284a971f-debbef4858334d7e","baggage":"sentry-trace_id=3b6fde82574f43fa849216f6284a971f,sentry-release=Unknown"},"correlation_id":"01KZR48TTJJKSTHK8PE2Q1SJF1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdbb0a75514ec6637f2e747b0393fd13cbdf5bd76519f6053807fb1cf3051bc8","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:47.649Z","job_size_bytes":2591,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-6a864a4b89d14caedc9b9f48: done: 0.092506 sec","job_status":"done","queue_duration_s":0.12858,"scheduling_latency_s":0.128625,"redis_calls":10,"redis_duration_s":0.004654,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047596,"duration_s":0.092506,"completed_at":"2026-08-11T10:00:47.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.040259] gitaly[909]: time="2026-08-11T10:00:47.932Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48YYCM0H40ACFA2KJZNDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:47.915" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 336.051284] gitlab-workhorse[818]: time="2026-08-11T10:00:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 336.053326] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 113 gitlab # [ 336.055164] gitaly[909]: time="2026-08-11T10:00:47.932Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48YYCM0H40ACFA2KJZNDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:47.915" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.068730] gitaly[909]: time="2026-08-11T10:00:47.933Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48YYCM0H40ACFA2KJZNDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:47.915" grpc.time_ms=17.319 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.173328] gitaly[909]: time="2026-08-11T10:00:48.074Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48Z205Z76PWYJR22HSXXK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.039" pid=909 remote_ip="2001:db8:1::1" request_sha=f35a716ae5b57d5737c32adb99a7fa833d48d4fd response_bytes=337 span.kind=server system=grpc gitlab # [ 336.205350] gitaly[909]: time="2026-08-11T10:00:48.074Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=1 command.system_time_ms=26 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48Z205Z76PWYJR22HSXXK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.039" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.238072] gitlab-workhorse[818]: time="2026-08-11T10:00:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 336.241438] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 138 gitlab # [ 336.244664] gitaly[909]: time="2026-08-11T10:00:48.075Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=1 command.system_time_ms=26 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48Z205Z76PWYJR22HSXXK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.039" grpc.time_ms=35.827 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.391447] gitaly[909]: time="2026-08-11T10:00:48.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48Z9CEFM0T0TA1JNSAKP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.273" grpc.time_ms=17.731 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.431091] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 119 gitlab # [ 336.534862] gitaly[909]: time="2026-08-11T10:00:48.436Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZD77N4FJ2ETSZPDMBWS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.402" pid=909 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 336.567239] gitaly[909]: time="2026-08-11T10:00:48.436Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZD77N4FJ2ETSZPDMBWS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.402" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.603694] gitlab-workhorse[818]: time="2026-08-11T10:00:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 336.608066] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 142 gitlab # [ 336.612318] gitaly[909]: time="2026-08-11T10:00:48.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZD77N4FJ2ETSZPDMBWS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:48.402" grpc.time_ms=34.383 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.641782] nixbot[3527]: {"ts": "2026-08-11T10:00:48.508Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"} gitlab # [ 336.646295] nix-daemon[3853]: unexpected Nix daemon error: error: interrupted by the user gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53' gitlab # [ 336.707605] nixbot[3527]: INFO: ::ffff:127.0.0.1:43676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7f3c80af95af72a8d0871ce61310ae60630dae53', in 0.06 seconds) (finished: subtest: push delivers the webhook, in 5.62 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 336.762310] gitaly[909]: time="2026-08-11T10:00:48.663Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:18.561" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:48.662" grpc.time_ms=0.942 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.790130] gitaly[909]: time="2026-08-11T10:00:48.687Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:18.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:48.686" grpc.time_ms=0.97 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.861493] gitaly[909]: time="2026-08-11T10:00:48.762Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZRMX67PFHXRKKG742FN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:18.659" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:48.760" grpc.time_ms=1.843 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.896327] gitaly[909]: time="2026-08-11T10:00:48.792Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:01:18.175" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:48.776" grpc.time_ms=16.517 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.922490] gitaly[909]: time="2026-08-11T10:00:48.811Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:58.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:48.801" grpc.time_ms=9.315 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.945082] gitaly[909]: time="2026-08-11T10:00:48.828Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:58.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:48.811" grpc.time_ms=16.992 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.975969] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 215 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.27 seconds) gitlab # [ 337.012747] gitaly[909]: time="2026-08-11T10:00:48.913Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:00:58.062" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:48.913" grpc.time_ms=0.644 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.034851] gitaly[909]: time="2026-08-11T10:00:48.927Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:00:58.068" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:48.919" grpc.time_ms=7.937 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.057793] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:48.919Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"16d71f60903d928d40396744","created_at":"2026-08-11T10:00:48.909Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-0843cfd0b3cc4502","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:48.917Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-16d71f60903d928d40396744: start","job_status":"start","queue_duration_s":0.002208,"scheduling_latency_s":0.002259} gitlab # [ 337.079829] nixbot[3527]: {"ts": "2026-08-11T10:00:48.956Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/991c700b2b15bfebffb92ab44a1270cba973f2e6 \"HTTP/1.1 201 Created\""} gitlab # [ 337.083515] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/991c700b2b15bfebffb92ab44a1270cba973f2e6 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 382 gitlab # [ 337.086708] gitaly[909]: time="2026-08-11T10:00:48.970Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:48.969" grpc.time_ms=0.687 pid=909 span.kind=server system=grpc gitlab # [ 337.099925] gitaly[909]: time="2026-08-11T10:00:49.000Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:49.000" grpc.time_ms=0.39 pid=909 span.kind=server system=grpc gitlab # [ 337.111770] gitaly[909]: time="2026-08-11T10:00:49.005Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T diskcache=66cd93e0-0231-44da-b7e0-c41dfd53b192 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:00:58.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:48.930" pid=909 ref=refs/keep-around/7f3c80af95af72a8d0871ce61310ae60630dae53 remote_ip="2001:db8:1::1" revision=7f3c80af95af72a8d0871ce61310ae60630dae53 span.kind=server system=grpc username=root gitlab # [ 337.126962] gitaly[909]: time="2026-08-11T10:00:49.006Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5347 command.oublock=8 command.real_time_ms=71 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:00:58.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:00:48.930" grpc.time_ms=75.8 pid=909 ref=refs/keep-around/7f3c80af95af72a8d0871ce61310ae60630dae53 remote_ip="2001:db8:1::1" revision=7f3c80af95af72a8d0871ce61310ae60630dae53 span.kind=server system=grpc username=root gitlab # [ 337.143819] gitaly[909]: time="2026-08-11T10:00:49.009Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:19.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:49.008" grpc.time_ms=0.37 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.157428] gitaly[909]: time="2026-08-11T10:00:49.039Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR49026HCH6042Q5ZQJ61CY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:19.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:49.039" grpc.time_ms=0.566 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.185478] gitaly[909]: time="2026-08-11T10:00:49.086Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR49026HCH6042Q5ZQJ61CY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:00:59.066" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:49.077" grpc.time_ms=8.943 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.199569] gitaly[909]: time="2026-08-11T10:00:49.091Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:49.091" grpc.time_ms=0.296 pid=909 span.kind=server system=grpc gitlab # [ 337.216313] gitaly[909]: time="2026-08-11T10:00:49.117Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:49.117" grpc.time_ms=0.452 pid=909 span.kind=server system=grpc gitlab # [ 337.239763] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/991c700b2b15bfebffb92ab44a1270cba973f2e6 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 174 gitlab # [ 337.244788] nixbot[3527]: {"ts": "2026-08-11T10:00:49.142Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/991c700b2b15bfebffb92ab44a1270cba973f2e6 \"HTTP/1.1 201 Created\""} gitlab # [ 337.247617] gitaly[909]: time="2026-08-11T10:00:49.142Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:49.142" grpc.time_ms=0.285 pid=909 span.kind=server system=grpc gitlab # [ 337.258289] gitaly[909]: time="2026-08-11T10:00:49.151Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE diskcache=a3e6c05a-044a-4995-8b57-7fb7af72b0ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:19.057" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:49.058" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.268379] gitaly[909]: time="2026-08-11T10:00:49.151Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7023 command.oublock=0 command.real_time_ms=88 command.spawn_token_fork_ms=2 command.system_time_ms=45 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:19.057" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:49.058" grpc.time_ms=93.32 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.297323] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 681 gitlab # [ 337.299852] nixbot[3527]: {"ts": "2026-08-11T10:00:49.199Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 \"HTTP/1.1 201 Created\""} gitlab # [ 337.304887] nixbot[3527]: {"ts": "2026-08-11T10:00:49.206Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-7f3c80af95af-1"} gitlab # [ 337.337472] gitaly[909]: time="2026-08-11T10:00:49.238Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:19.237" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:49.237" grpc.time_ms=0.872 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.367872] nix-daemon[3806]: accepted connection from pid 3993, user nixbot gitlab # [ 337.377288] gitaly[909]: time="2026-08-11T10:00:49.278Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:19.277" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:49.277" grpc.time_ms=0.698 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.391938] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.288Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d6cd8059bfa7e2b893c0c4c2","created_at":"2026-08-11T10:00:49.286Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"16d71f60903d928d40396744","job_size_bytes":3,"pid":2024,"job_status":"deduplicated","message":"PipelineProcessWorker JID-d6cd8059bfa7e2b893c0c4c2: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 337.408287] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.290Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"16d71f60903d928d40396744","created_at":"2026-08-11T10:00:48.909Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-0843cfd0b3cc4502","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:48.917Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2024,"job_status":"rescheduled","message":"PipelineProcessWorker JID-16d71f60903d928d40396744: rescheduled"} gitlab # [ 337.422998] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.298Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"16d71f60903d928d40396744","created_at":"2026-08-11T10:00:48.909Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-0843cfd0b3cc4502","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:48.917Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-16d71f60903d928d40396744: done: 0.37908 sec","job_status":"done","queue_duration_s":0.002208,"scheduling_latency_s":0.002259,"gitaly_calls":3,"gitaly_duration_s":0.101637,"redis_calls":96,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019197,"redis_read_bytes":251,"redis_write_bytes":23272,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000893,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00097,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.005593,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.002909,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12386,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005713,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000194,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001694,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":43,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":43,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":27,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.220999,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.30373428,"duration_s":0.37908,"completed_at":"2026-08-11T10:00:49.298Z","load_balancing_strategy":"primary","db_duration_s":0.045201,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 337.475796] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.299Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"d35095f05e6db454d74705f8","created_at":"2026-08-11T10:00:49.020Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-4837045f37e44e46","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.025Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-d35095f05e6db454d74705f8: start","job_status":"start","queue_duration_s":0.273922,"scheduling_latency_s":0.273949} gitlab # [ 337.493402] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.333Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"d35095f05e6db454d74705f8","created_at":"2026-08-11T10:00:49.020Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-4837045f37e44e46","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.025Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-d35095f05e6db454d74705f8: done: 0.033435 sec","job_status":"done","queue_duration_s":0.273922,"scheduling_latency_s":0.273949,"redis_calls":7,"redis_duration_s":0.001291,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033435,"completed_at":"2026-08-11T10:00:49.333Z","load_balancing_strategy":"primary","db_duration_s":0.004153,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 337.537417] nix-daemon[3806]: accepted connection from pid 4001, user nixbot gitlab # [ 337.538372] nixbot[3527]: {"ts": "2026-08-11T10:00:49.389Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-7f3c80af95af-1", "argv0": "bwrap"} gitlab # [ 337.540779] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.334Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e496fec0b79dd3a089a8ca9f","created_at":"2026-08-11T10:00:49.026Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-4837045f37e44e46","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.030Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e496fec0b79dd3a089a8ca9f: start","job_status":"start","queue_duration_s":0.304036,"scheduling_latency_s":0.304058} gitlab # [ 337.558356] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.391Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e496fec0b79dd3a089a8ca9f","created_at":"2026-08-11T10:00:49.026Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-4837045f37e44e46","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.030Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e496fec0b79dd3a089a8ca9f: done: 0.056602 sec","job_status":"done","queue_duration_s":0.304036,"scheduling_latency_s":0.304058,"redis_calls":10,"redis_duration_s":0.001262,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056602,"completed_at":"2026-08-11T10:00:49.391Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.602436] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.392Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c8cf82d63bd75af463e15a18","created_at":"2026-08-11T10:00:49.037Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.044Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c8cf82d63bd75af463e15a18: start","job_status":"start","queue_duration_s":0.348114,"scheduling_latency_s":0.348134} gitlab # [ 337.618971] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.515Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c8cf82d63bd75af463e15a18","created_at":"2026-08-11T10:00:49.037Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.044Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c8cf82d63bd75af463e15a18: done: 0.122883 sec","job_status":"done","queue_duration_s":0.348114,"scheduling_latency_s":0.348134,"redis_calls":19,"redis_duration_s":0.003966,"redis_read_bytes":17,"redis_write_bytes":3684,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001383,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":967,"redis_queues_calls":2,"redis_queues_duration_s":0.000368,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1627,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000446,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":18,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":18,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095494,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031756,"duration_s":0.122883,"completed_at":"2026-08-11T10:00:49.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022001,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 337.666486] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.516Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"506d8b716d92cb2b7617dc31","created_at":"2026-08-11T10:00:49.503Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-91a265bb61294fff","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:4c684d7ac17d92ab801c7c30184fef9e8713bdd1c946a503d19b8e3eae4b9ccb","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.508Z","job_size_bytes":464,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-506d8b716d92cb2b7617dc31: start","job_status":"start","queue_duration_s":0.008433,"scheduling_latency_s":0.008449} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 337.682525] sidekiq-cluster[2024]: {"severity":"WARN","time":"2026-08-11T10:00:49.574Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"506d8b716d92cb2b7617dc31","created_at":"2026-08-11T10:00:49.503Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-91a265bb61294fff","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:4c684d7ac17d92ab801c7c30184fef9e8713bdd1c946a503d19b8e3eae4b9ccb","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.508Z","job_size_bytes":464,"pid":2024,"sidekiq_tid":"maok","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-506d8b716d92cb2b7617dc31: fail: 0.057318 sec","job_status":"fail","queue_duration_s":0.008433,"scheduling_latency_s":0.008449,"redis_calls":9,"redis_duration_s":0.002257,"redis_read_bytes":8,"redis_write_bytes":1136,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":585,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041742,"duration_s":0.057318,"completed_at":"2026-08-11T10:00:49.573Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/rrv9bm690ckpz77hha6n0n51mxsbvqx4-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/rrv9bm690ckpz77hha6n0n51mxsbvqx4-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/rrv9bm690ckpz77hha6n0n51mxsbvqx4-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/base.rb:152:in `process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/26xsw4aa1hlr5dffsy03i1p25i3sj6nh-ruby3.3-actionview-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionview-7.2.3.1/lib/action_view/rendering.rb:40:in `process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/base.rb:651:in `process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/xcga4rn1mfaph6kv3z5dky53n4ix38q7-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/z1b9x0igifidmk4a5aq176krxshr4j2p-ruby3.3-i18n-1.14.8/lib/ruby/gems/3.3.0/gems/i18n-1.14.8/lib/i18n.rb:354:in `with_locale'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/zm4016ybvgvxwp38ki20jl1q8y9nk0vp-ruby3.3-activerecord-7.2.3.1/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3.1/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/zm4016ybvgvxwp38ki20jl1q8y9nk0vp-ruby3.3-activerecord-7.2.3.1/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3.1/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/3j1v9jjaf4mfhwwdkc5skmmh8srsn03g-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:27:in `execute'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/context.rb:43:in `with_context'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/xcga4rn1mfaph6kv3z5dky53n4ix38q7-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/057zb68nv365hwg6mvz9k9jkqc8h5ki3-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.01758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.078401] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.578Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2ddd29ee657f1170914a6f25","created_at":"2026-08-11T10:00:49.157Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.162Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2ddd29ee657f1170914a6f25: start","job_status":"start","queue_duration_s":0.416111,"scheduling_latency_s":0.416157} gitlab # [ 338.095086] nix-daemon[3806]: accepted connection from pid 4013, user nixbot gitlab # [ 338.096084] nix-daemon[3806]: accepted connection from pid 4023, user nixbot gitlab # [ 338.097036] nix-daemon[3806]: accepted connection from pid 4013, user nixbot gitlab # [ 338.098302] gitaly[909]: time="2026-08-11T10:00:49.884Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:19.882" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:49.882" grpc.time_ms=1.371 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.111600] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.795Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2ddd29ee657f1170914a6f25","created_at":"2026-08-11T10:00:49.157Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.162Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2ddd29ee657f1170914a6f25: done: 0.216985 sec","job_status":"done","queue_duration_s":0.416111,"scheduling_latency_s":0.416157,"redis_calls":10,"redis_duration_s":0.003813,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000852,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000827,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034922,"duration_s":0.216985,"completed_at":"2026-08-11T10:00:49.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.159030] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.798Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d0d064f64f3562551cd73d11","created_at":"2026-08-11T10:00:49.173Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-4837045f37e44e46","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.177Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d0d064f64f3562551cd73d11: start","job_status":"start","queue_duration_s":0.621266,"scheduling_latency_s":0.621286} gitlab # [ 338.175712] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.953Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d0d064f64f3562551cd73d11","created_at":"2026-08-11T10:00:49.173Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-4837045f37e44e46","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.177Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d0d064f64f3562551cd73d11: done: 0.154538 sec","job_status":"done","queue_duration_s":0.621266,"scheduling_latency_s":0.621286,"gitaly_calls":2,"gitaly_duration_s":0.007415,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009735,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001161,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001216,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000842,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002551,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000363,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001023,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.1108,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10730796,"duration_s":0.154538,"completed_at":"2026-08-11T10:00:49.953Z","load_balancing_strategy":"primary","db_duration_s":0.031545,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 338.229488] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:49.963Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"58d462b7365796709284429a","created_at":"2026-08-11T10:00:49.175Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.182Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-58d462b7365796709284429a: start","job_status":"start","queue_duration_s":0.7808,"scheduling_latency_s":0.780849} gitlab # [ 338.245851] gitaly[909]: time="2026-08-11T10:00:49.927Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZM4Y6AMBM1BXEENA49T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:19.626" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:49.926" grpc.time_ms=0.818 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.258771] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:50.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"58d462b7365796709284429a","created_at":"2026-08-11T10:00:49.175Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.182Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-58d462b7365796709284429a: done: 0.066646 sec","job_status":"done","queue_duration_s":0.7808,"scheduling_latency_s":0.780849,"redis_calls":10,"redis_duration_s":0.00923,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000896,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006325,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054432,"duration_s":0.066646,"completed_at":"2026-08-11T10:00:50.029Z","load_balancing_strategy":"primary","db_duration_s":0.009767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.303672] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:50.033Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"312f7dfb90fe9c6927321496","created_at":"2026-08-11T10:00:49.190Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.195Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-312f7dfb90fe9c6927321496: start","job_status":"start","queue_duration_s":0.837563,"scheduling_latency_s":0.837585} gitlab # [ 338.319944] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:50.122Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"312f7dfb90fe9c6927321496","created_at":"2026-08-11T10:00:49.190Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.195Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-312f7dfb90fe9c6927321496: done: 0.089604 sec","job_status":"done","queue_duration_s":0.837563,"scheduling_latency_s":0.837585,"redis_calls":13,"redis_duration_s":0.005308,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00102,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002498,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000913,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060738,"duration_s":0.089604,"completed_at":"2026-08-11T10:00:50.122Z","load_balancing_strategy":"primary","db_duration_s":0.009947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.367779] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:50.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"acca1ed299a4a3cc1b910e08","created_at":"2026-08-11T10:00:49.196Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.201Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-acca1ed299a4a3cc1b910e08: start","job_status":"start","queue_duration_s":0.924149,"scheduling_latency_s":0.924181} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.41 seconds) gitlab # [ 338.384071] gitaly[909]: time="2026-08-11T10:00:50.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4910V7JXPS0Z5RH4WY9JW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:20.197" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:50.198" grpc.time_ms=1.219 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.396270] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 317 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 339.381776] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"acca1ed299a4a3cc1b910e08","created_at":"2026-08-11T10:00:49.196Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.201Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-acca1ed299a4a3cc1b910e08: done: 1.153236 sec","job_status":"done","queue_duration_s":0.924149,"scheduling_latency_s":0.924181,"redis_calls":10,"redis_duration_s":0.180016,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.172554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.814,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.803,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088774,"duration_s":1.153236,"completed_at":"2026-08-11T10:00:51.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.814241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 339.387484] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e583e6610ca3bd84b84d0a70","created_at":"2026-08-11T10:00:49.202Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.206Z","job_size_bytes":19,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e583e6610ca3bd84b84d0a70: start","job_status":"start","queue_duration_s":2.079198,"scheduling_latency_s":2.079233} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.22 seconds) gitlab # [ 339.541399] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e583e6610ca3bd84b84d0a70","created_at":"2026-08-11T10:00:49.202Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.206Z","job_size_bytes":19,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e583e6610ca3bd84b84d0a70: done: 0.153471 sec","job_status":"done","queue_duration_s":2.079198,"scheduling_latency_s":2.079233,"redis_calls":11,"redis_duration_s":0.014269,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000818,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.012659,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000792,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00130472,"duration_s":0.153471,"completed_at":"2026-08-11T10:00:51.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 339.651680] gitaly[909]: time="2026-08-11T10:00:51.463Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR492DMSGFNPKQM1M2HRPTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:21.361" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:51.462" grpc.time_ms=0.663 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.670802] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 130 gitlab # [ 339.674336] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.443Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd118534552a13498abe4e70","created_at":"2026-08-11T10:00:49.209Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.213Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd118534552a13498abe4e70: start","job_status":"start","queue_duration_s":2.230235,"scheduling_latency_s":2.230256} gitlab # [ 339.694570] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.519Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd118534552a13498abe4e70","created_at":"2026-08-11T10:00:49.209Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.213Z","job_size_bytes":65,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd118534552a13498abe4e70: done: 0.075177 sec","job_status":"done","queue_duration_s":2.230235,"scheduling_latency_s":2.230256,"redis_calls":10,"redis_duration_s":0.002717,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000535,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001585,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000597,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003448,"duration_s":0.075177,"completed_at":"2026-08-11T10:00:51.518Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 339.740922] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.530Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b9b164943bc99cdd80477b5f","created_at":"2026-08-11T10:00:49.214Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.216Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b9b164943bc99cdd80477b5f: start","job_status":"start","queue_duration_s":2.313717,"scheduling_latency_s":2.31374} gitlab # [ 339.772969] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b9b164943bc99cdd80477b5f","created_at":"2026-08-11T10:00:49.214Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.216Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b9b164943bc99cdd80477b5f: done: 0.137374 sec","job_status":"done","queue_duration_s":2.313717,"scheduling_latency_s":2.31374,"redis_calls":7,"redis_duration_s":0.00453,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002618,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.137374,"completed_at":"2026-08-11T10:00:51.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 339.831014] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.677Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"fa39475cfe8dec8667754096","created_at":"2026-08-11T10:00:49.218Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.223Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-fa39475cfe8dec8667754096: start","job_status":"start","queue_duration_s":2.453419,"scheduling_latency_s":2.453463} gitlab # [ 339.947637] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"fa39475cfe8dec8667754096","created_at":"2026-08-11T10:00:49.218Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.223Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-fa39475cfe8dec8667754096: done: 0.168315 sec","job_status":"done","queue_duration_s":2.453419,"scheduling_latency_s":2.453463,"redis_calls":10,"redis_duration_s":0.010792,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000723,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048008,"duration_s":0.168315,"completed_at":"2026-08-11T10:00:51.845Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 340.053562] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.851Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b9af87399cc1b87938d2b0cf","created_at":"2026-08-11T10:00:49.224Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.228Z","job_size_bytes":6,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b9af87399cc1b87938d2b0cf: start","job_status":"start","queue_duration_s":2.622911,"scheduling_latency_s":2.622937} gitlab # [ 340.073825] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.951Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b9af87399cc1b87938d2b0cf","created_at":"2026-08-11T10:00:49.224Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.228Z","job_size_bytes":6,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b9af87399cc1b87938d2b0cf: done: 0.100958 sec","job_status":"done","queue_duration_s":2.622911,"scheduling_latency_s":2.622937,"redis_calls":10,"redis_duration_s":0.003123,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000642,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00236092,"duration_s":0.100958,"completed_at":"2026-08-11T10:00:51.951Z","load_balancing_strategy":"primary","db_duration_s":0.004144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 340.118952] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:51.955Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e460d0e03905a4ca62570ca6","created_at":"2026-08-11T10:00:49.291Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.292Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e460d0e03905a4ca62570ca6: start","job_status":"start","queue_duration_s":2.662768,"scheduling_latency_s":2.662788} gitlab # [ 340.217487] gitaly[909]: time="2026-08-11T10:00:52.118Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:22.116" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:52.116" grpc.time_ms=1.469 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 340.323820] gitaly[909]: time="2026-08-11T10:00:52.224Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR48ZNVKDAV7V9FCT8DVFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:22.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:52.223" grpc.time_ms=1.399 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 340.384236] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:52.279Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e460d0e03905a4ca62570ca6","created_at":"2026-08-11T10:00:49.291Z","trace_propagation_headers":{"sentry-trace":"43d8c7cb13994cf69e0aab45fb100620-4c11f9fcbfd74009","baggage":"sentry-trace_id=43d8c7cb13994cf69e0aab45fb100620,sentry-release=Unknown"},"correlation_id":"01KZR48ZNVKDAV7V9FCT8DVFDE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.292Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e460d0e03905a4ca62570ca6: done: 0.323511 sec","job_status":"done","queue_duration_s":2.662768,"scheduling_latency_s":2.662788,"gitaly_calls":2,"gitaly_duration_s":0.016056,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009315,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002473,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002815,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000283,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003744,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":23,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":23,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.267379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20759542,"duration_s":0.323511,"completed_at":"2026-08-11T10:00:52.279Z","load_balancing_strategy":"primary","db_duration_s":0.036878,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 340.435870] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:52.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f4d2b92b9e1dbd56ca828f19","created_at":"2026-08-11T10:00:49.863Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-74cbadfdc2954e0a","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.865Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f4d2b92b9e1dbd56ca828f19: start","job_status":"start","queue_duration_s":2.421923,"scheduling_latency_s":2.421959} gitlab # [ 340.528603] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:52.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f4d2b92b9e1dbd56ca828f19","created_at":"2026-08-11T10:00:49.863Z","trace_propagation_headers":{"sentry-trace":"c9b1ebe7fa0b44e3be17436c696d509d-74cbadfdc2954e0a","baggage":"sentry-trace_id=c9b1ebe7fa0b44e3be17436c696d509d,sentry-release=Unknown"},"correlation_id":"01KZR48ZM4Y6AMBM1BXEENA49T","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:49.865Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f4d2b92b9e1dbd56ca828f19: done: 0.134472 sec","job_status":"done","queue_duration_s":2.421923,"scheduling_latency_s":2.421959,"redis_calls":7,"redis_duration_s":0.005042,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003323,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.134472,"completed_at":"2026-08-11T10:00:52.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 340.800509] gitaly[909]: time="2026-08-11T10:00:52.700Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR493K9NDCKB7E1A4TKCF27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:22.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:52.698" grpc.time_ms=1.269 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.24 seconds) gitlab # [ 340.850861] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 165 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 342.012889] gitaly[909]: time="2026-08-11T10:00:53.912Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR494SG97DEQMGG9P02KZ4Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:23.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:53.911" grpc.time_ms=1.33 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.22 seconds) gitlab # [ 342.069546] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 160 gitlab # [ 342.463215] gitaly[909]: time="2026-08-11T10:00:54.364Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:24.262" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:54.362" grpc.time_ms=1.203 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.544001] gitaly[909]: time="2026-08-11T10:00:54.445Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:01:04.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:54.427" grpc.time_ms=17.583 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.631364] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:54.528Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b4a475d15a799a93003167d0","created_at":"2026-08-11T10:00:54.516Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-5fcd4c97aae74f1c","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.523Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b4a475d15a799a93003167d0: start","job_status":"start","queue_duration_s":0.004804,"scheduling_latency_s":0.004884} gitlab # [ 342.680209] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 304 gitlab # [ 342.686868] nixbot[3527]: {"ts": "2026-08-11T10:00:54.560Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 \"HTTP/1.1 201 Created\""} gitlab # [ 342.777277] gitaly[909]: time="2026-08-11T10:00:54.678Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR495H9CVJ2RAMV0KAKTFDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:24.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:54.676" grpc.time_ms=1.382 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.956117] gitaly[909]: time="2026-08-11T10:00:54.857Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:54.856" grpc.time_ms=0.807 pid=909 span.kind=server system=grpc gitlab # [ 342.982517] gitaly[909]: time="2026-08-11T10:00:54.863Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZR495H9CVJ2RAMV0KAKTFDH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:01:04.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:54.841" grpc.time_ms=21.167 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.010601] gitaly[909]: time="2026-08-11T10:00:54.911Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:54.910" grpc.time_ms=0.739 pid=909 span.kind=server system=grpc gitlab # [ 343.026960] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 358 gitlab # [ 343.031399] nixbot[3527]: {"ts": "2026-08-11T10:00:54.929Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 \"HTTP/1.1 201 Created\""} gitlab # [ 343.055691] gitaly[909]: time="2026-08-11T10:00:54.956Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:54.955" grpc.time_ms=0.533 pid=909 span.kind=server system=grpc gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 343.074179] gitaly[909]: time="2026-08-11T10:00:54.968Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S diskcache=92cfc4c5-7b0e-4dd6-83a7-61ae169a36de grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:24.792" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:54.793" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.096066] gitaly[909]: time="2026-08-11T10:00:54.968Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=176 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7355 command.oublock=0 command.real_time_ms=169 command.spawn_token_fork_ms=1 command.system_time_ms=122 command.user_time_ms=54 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:24.792" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:54.793" grpc.time_ms=174.702 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.131275] gitaly[909]: time="2026-08-11T10:00:55.032Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR495X0NYKZ5JT6ES7ZN2X6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:25.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:55.031" grpc.time_ms=0.716 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.179527] gitaly[909]: time="2026-08-11T10:00:55.080Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZR495X0NYKZ5JT6ES7ZN2X6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:01:05.060" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.070" grpc.time_ms=9.342 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.203308] gitaly[909]: time="2026-08-11T10:00:55.082Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR495YZZ6X02RFYVPEWKG06 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:25.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:55.079" grpc.time_ms=2.177 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.222584] gitaly[909]: time="2026-08-11T10:00:55.112Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:25.110" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:55.111" grpc.time_ms=1.415 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.250760] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 142 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.18 seconds) gitlab # [ 343.255026] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 206 gitlab # [ 343.260113] nixbot[3527]: {"ts": "2026-08-11T10:00:55.152Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7f3c80af95af72a8d0871ce61310ae60630dae53 \"HTTP/1.1 201 Created\""} gitlab # [ 343.264334] gitaly[909]: time="2026-08-11T10:00:55.158Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:25.156" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:55.157" grpc.time_ms=0.788 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.282439] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.173Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"75523ea07928f8baed96c601","created_at":"2026-08-11T10:00:55.171Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b4a475d15a799a93003167d0","job_size_bytes":3,"pid":2024,"job_status":"deduplicated","message":"PipelineProcessWorker JID-75523ea07928f8baed96c601: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 343.301787] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.175Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b4a475d15a799a93003167d0","created_at":"2026-08-11T10:00:54.516Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-5fcd4c97aae74f1c","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.523Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2024,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b4a475d15a799a93003167d0: rescheduled"} gitlab # [ 343.318152] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.184Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b4a475d15a799a93003167d0","created_at":"2026-08-11T10:00:54.516Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-5fcd4c97aae74f1c","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.523Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b4a475d15a799a93003167d0: done: 0.658467 sec","job_status":"done","queue_duration_s":0.004804,"scheduling_latency_s":0.004884,"gitaly_calls":3,"gitaly_duration_s":0.18851,"redis_calls":88,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.034401,"redis_read_bytes":250,"redis_write_bytes":24184,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002025,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002681,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.004689,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1083,"redis_queues_calls":27,"redis_queues_duration_s":0.009854,"redis_queues_read_bytes":31,"redis_queues_write_bytes":15578,"redis_queues_metadata_calls":24,"redis_queues_metadata_duration_s":0.008977,"redis_queues_metadata_read_bytes":114,"redis_queues_metadata_write_bytes":3962,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000472,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000872,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002806,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.377075,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.55289936,"duration_s":0.658467,"completed_at":"2026-08-11T10:00:55.184Z","load_balancing_strategy":"primary","db_duration_s":0.080746,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 343.371806] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.186Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8abd32ae6bb504f2017df293","created_at":"2026-08-11T10:00:54.774Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.779Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8abd32ae6bb504f2017df293: start","job_status":"start","queue_duration_s":0.406387,"scheduling_latency_s":0.406412} gitlab # [ 343.388703] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8abd32ae6bb504f2017df293","created_at":"2026-08-11T10:00:54.774Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.779Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8abd32ae6bb504f2017df293: done: 0.051762 sec","job_status":"done","queue_duration_s":0.406387,"scheduling_latency_s":0.406412,"redis_calls":7,"redis_duration_s":0.001307,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051762,"completed_at":"2026-08-11T10:00:55.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010698,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 343.431778] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.239Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"258291ac3c3743e1af4af995","created_at":"2026-08-11T10:00:54.975Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.981Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-258291ac3c3743e1af4af995: start","job_status":"start","queue_duration_s":0.258258,"scheduling_latency_s":0.258282} gitlab # [ 343.449892] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.272Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"258291ac3c3743e1af4af995","created_at":"2026-08-11T10:00:54.975Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.981Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-258291ac3c3743e1af4af995: done: 0.033103 sec","job_status":"done","queue_duration_s":0.258258,"scheduling_latency_s":0.258282,"redis_calls":7,"redis_duration_s":0.001133,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033103,"completed_at":"2026-08-11T10:00:55.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.524799] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6d0759bf60041c22b9632b6c","created_at":"2026-08-11T10:00:54.993Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.997Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6d0759bf60041c22b9632b6c: start","job_status":"start","queue_duration_s":0.27646,"scheduling_latency_s":0.276483} gitlab # [ 343.545641] nix-daemon[3806]: accepted connection from pid 4104, user nixbot gitlab # [ 343.546756] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 70 gitlab # [ 343.549251] gitaly[909]: time="2026-08-11T10:00:55.395Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4968W5VMEZZAJME5XGQRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:55.384" grpc.time_ms=10.951 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 343.563620] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.316Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6d0759bf60041c22b9632b6c","created_at":"2026-08-11T10:00:54.993Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:54.997Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6d0759bf60041c22b9632b6c: done: 0.041645 sec","job_status":"done","queue_duration_s":0.27646,"scheduling_latency_s":0.276483,"redis_calls":7,"redis_duration_s":0.003213,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041645,"completed_at":"2026-08-11T10:00:55.315Z","load_balancing_strategy":"primary","db_duration_s":0.007142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.608512] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.318Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"f95fd54ac33dda18fd13fde7","created_at":"2026-08-11T10:00:55.013Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.019Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f95fd54ac33dda18fd13fde7: start","job_status":"start","queue_duration_s":0.299464,"scheduling_latency_s":0.299487} gitlab # [ 343.623971] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"f95fd54ac33dda18fd13fde7","created_at":"2026-08-11T10:00:55.013Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.019Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f95fd54ac33dda18fd13fde7: done: 0.038341 sec","job_status":"done","queue_duration_s":0.299464,"scheduling_latency_s":0.299487,"redis_calls":10,"redis_duration_s":0.004588,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000583,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038341,"completed_at":"2026-08-11T10:00:55.356Z","load_balancing_strategy":"primary","db_duration_s":0.005567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.667763] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.358Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8685a60a0a33c260e7bcafb9","created_at":"2026-08-11T10:00:55.020Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.023Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8685a60a0a33c260e7bcafb9: start","job_status":"start","queue_duration_s":0.334843,"scheduling_latency_s":0.334862} gitlab # [ 343.684409] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8685a60a0a33c260e7bcafb9","created_at":"2026-08-11T10:00:55.020Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.023Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8685a60a0a33c260e7bcafb9: done: 0.031039 sec","job_status":"done","queue_duration_s":0.334843,"scheduling_latency_s":0.334862,"redis_calls":7,"redis_duration_s":0.002468,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031039,"completed_at":"2026-08-11T10:00:55.389Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.728702] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.390Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"96b59aad85916a9b77b4384c","created_at":"2026-08-11T10:00:55.024Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.028Z","job_size_bytes":19,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-96b59aad85916a9b77b4384c: start","job_status":"start","queue_duration_s":0.362511,"scheduling_latency_s":0.362528} gitlab # [ 343.744695] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.417Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"96b59aad85916a9b77b4384c","created_at":"2026-08-11T10:00:55.024Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.028Z","job_size_bytes":19,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-96b59aad85916a9b77b4384c: done: 0.026438 sec","job_status":"done","queue_duration_s":0.362511,"scheduling_latency_s":0.362528,"redis_calls":8,"redis_duration_s":0.001667,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026438,"completed_at":"2026-08-11T10:00:55.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.786946] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.418Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"de887e9ceb93bcf168c2ce30","created_at":"2026-08-11T10:00:55.030Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.036Z","job_size_bytes":66,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-de887e9ceb93bcf168c2ce30: start","job_status":"start","queue_duration_s":0.382346,"scheduling_latency_s":0.382362} gitlab # [ 343.804360] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.441Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"de887e9ceb93bcf168c2ce30","created_at":"2026-08-11T10:00:55.030Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.036Z","job_size_bytes":66,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-de887e9ceb93bcf168c2ce30: done: 0.022933 sec","job_status":"done","queue_duration_s":0.382346,"scheduling_latency_s":0.382362,"redis_calls":7,"redis_duration_s":0.001295,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022933,"completed_at":"2026-08-11T10:00:55.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.847428] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"95492a57e10a361c743d52a0","created_at":"2026-08-11T10:00:55.037Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.041Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-95492a57e10a361c743d52a0: start","job_status":"start","queue_duration_s":0.401349,"scheduling_latency_s":0.401365} gitlab # [ 343.863545] gitaly[909]: time="2026-08-11T10:00:55.461Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR496B4B1YM3XWE0TS35Q2C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:55.452" pid=909 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 343.873875] gitlab-workhorse[818]: time="2026-08-11T10:00:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 343.875672] gitlab-workhorse[818]: gitlab 2001:db8:1::1 - - [2026/08/11:10:00:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 65 gitlab # [ 343.877665] nix-daemon[3806]: accepted connection from pid 4129, user nixbot gitlab # [ 343.878605] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"95492a57e10a361c743d52a0","created_at":"2026-08-11T10:00:55.037Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.041Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-95492a57e10a361c743d52a0: done: 0.039512 sec","job_status":"done","queue_duration_s":0.401349,"scheduling_latency_s":0.401365,"redis_calls":7,"redis_duration_s":0.001683,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039512,"completed_at":"2026-08-11T10:00:55.482Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.922204] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.484Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"a10049dc3780595c1521a104","created_at":"2026-08-11T10:00:55.061Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.064Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a10049dc3780595c1521a104: start","job_status":"start","queue_duration_s":0.419185,"scheduling_latency_s":0.419204} gitlab # [ 343.938556] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.514Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"a10049dc3780595c1521a104","created_at":"2026-08-11T10:00:55.061Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.064Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a10049dc3780595c1521a104: done: 0.030694 sec","job_status":"done","queue_duration_s":0.419185,"scheduling_latency_s":0.419204,"redis_calls":7,"redis_duration_s":0.0030280000000000003,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001864,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030694,"completed_at":"2026-08-11T10:00:55.514Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 343.980583] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.516Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"bd8205e91fa03f867279be5f","created_at":"2026-08-11T10:00:55.065Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.068Z","job_size_bytes":6,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-bd8205e91fa03f867279be5f: start","job_status":"start","queue_duration_s":0.448281,"scheduling_latency_s":0.448299} gitlab # [ 343.996134] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.532Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"bd8205e91fa03f867279be5f","created_at":"2026-08-11T10:00:55.065Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.068Z","job_size_bytes":6,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-bd8205e91fa03f867279be5f: done: 0.01619 sec","job_status":"done","queue_duration_s":0.448281,"scheduling_latency_s":0.448299,"redis_calls":7,"redis_duration_s":0.0015210000000000002,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01619,"completed_at":"2026-08-11T10:00:55.532Z","load_balancing_strategy":"primary","db_duration_s":0.000566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 344.037958] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.534Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"03902d09e702b49e8add61ec","created_at":"2026-08-11T10:00:55.069Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.076Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-03902d09e702b49e8add61ec: start","job_status":"start","queue_duration_s":0.457614,"scheduling_latency_s":0.457632} gitlab # [ 344.053275] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"03902d09e702b49e8add61ec","created_at":"2026-08-11T10:00:55.069Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.076Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-03902d09e702b49e8add61ec: done: 0.038553 sec","job_status":"done","queue_duration_s":0.457614,"scheduling_latency_s":0.457632,"redis_calls":10,"redis_duration_s":0.001943,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026284,"duration_s":0.038553,"completed_at":"2026-08-11T10:00:55.572Z","load_balancing_strategy":"primary","db_duration_s":0.00684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 344.096551] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.574Z","retry":25,"queue":"default","version":0,"store":null,"args":["2"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"e7a694797941bc443e18198a","created_at":"2026-08-11T10:00:55.088Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf10f0c1762246c8bd0db4dbcbc12a17920d92b404b85de18593d239f34b91e7","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.098Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-e7a694797941bc443e18198a: start","job_status":"start","queue_duration_s":0.47627,"scheduling_latency_s":0.476295} gitlab # [ 344.113326] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.672Z","retry":25,"queue":"default","version":0,"store":null,"args":["2"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"e7a694797941bc443e18198a","created_at":"2026-08-11T10:00:55.088Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf10f0c1762246c8bd0db4dbcbc12a17920d92b404b85de18593d239f34b91e7","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.098Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-e7a694797941bc443e18198a: done: 0.098441 sec","job_status":"done","queue_duration_s":0.47627,"scheduling_latency_s":0.476295,"redis_calls":14,"redis_duration_s":0.004808,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009205,"duration_s":0.098441,"completed_at":"2026-08-11T10:00:55.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 344.157069] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:55.675Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2ca210ddcbcabaffcf193112","created_at":"2026-08-11T10:00:55.175Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.177Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ca210ddcbcabaffcf193112: start","job_status":"start","queue_duration_s":0.498071,"scheduling_latency_s":0.498109} gitlab # [ 344.173079] gitaly[909]: time="2026-08-11T10:00:55.462Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR496B4B1YM3XWE0TS35Q2C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:55.452" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 344.186347] gitaly[909]: time="2026-08-11T10:00:55.462Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR496B4B1YM3XWE0TS35Q2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:00:55.452" grpc.time_ms=9.556 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 344.200787] gitaly[909]: time="2026-08-11T10:00:55.859Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:55.859" grpc.time_ms=0.807 pid=909 span.kind=server system=grpc gitlab # [ 344.210221] gitaly[909]: time="2026-08-11T10:00:55.916Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:55.915" grpc.time_ms=0.803 pid=909 span.kind=server system=grpc gitlab # [ 344.219553] gitaly[909]: time="2026-08-11T10:00:55.973Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:00:55.972" grpc.time_ms=0.839 pid=909 span.kind=server system=grpc gitlab # [ 344.229243] gitaly[909]: time="2026-08-11T10:00:55.981Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:25.803" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.803" operations="[repack_refs]" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.238894] gitaly[909]: time="2026-08-11T10:00:55.985Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S diskcache=22ae70a0-a4f6-4d41-b30c-e152c3438d6d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:25.803" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.803" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses gitlab # [ 344.248715] gitaly[909]: time="2026-08-11T10:00:55.986Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=190 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7243 command.oublock=0 command.real_time_ms=175 command.spawn_token_fork_ms=1 command.system_time_ms=111 command.user_time_ms=79 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:25.803" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.803" grpc.time_ms=182.225 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.261289] gitaly[909]: time="2026-08-11T10:00:55.987Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:25.803" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.803" pid=909 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-11 10:00:35.15631138 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 344.272315] gitaly[909]: time="2026-08-11T10:00:56.038Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:25.803" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.803" pid=909 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 344.284318] gitaly[909]: time="2026-08-11T10:00:56.038Z" level=info msg="optimized repository" clean_stale_data_time=49.93354ms clean_work_trees_time="342.46µs" commit_graph_time="1.04µs" correlation_id=01KZR4957DRFP7WC2E5X1C700S gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.56µs" pid=909 prune_time=840ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="2.6µs" storage_name=default system=housekeeping total_time=50.32862ms gitlab # [ 344.289654] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.170Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2ca210ddcbcabaffcf193112","created_at":"2026-08-11T10:00:55.175Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-845a7ab70a844176","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.177Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ca210ddcbcabaffcf193112: done: 0.494642 sec","job_status":"done","queue_duration_s":0.498071,"scheduling_latency_s":0.498109,"gitaly_calls":3,"gitaly_duration_s":0.194642,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025271,"redis_read_bytes":144,"redis_write_bytes":16876,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000916,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002021,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.004677,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11225,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.011595,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000407,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002184,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002555,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.230896,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.43128412,"duration_s":0.494642,"completed_at":"2026-08-11T10:00:56.170Z","load_balancing_strategy":"primary","db_duration_s":0.054336,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 344.341533] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"45a567cdce39d10269b1f910","created_at":"2026-08-11T10:00:55.790Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-e391cbb1ecb94b83","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.794Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-45a567cdce39d10269b1f910: start","job_status":"start","queue_duration_s":0.378953,"scheduling_latency_s":0.378982} gitlab # [ 344.357924] gitaly[909]: time="2026-08-11T10:00:56.038Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:01:25.803" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:00:55.803" pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.367158] gitaly[909]: time="2026-08-11T10:00:56.094Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:01:26.092" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:56.093" grpc.time_ms=1.356 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.379732] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"45a567cdce39d10269b1f910","created_at":"2026-08-11T10:00:55.790Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-e391cbb1ecb94b83","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:55.794Z","job_size_bytes":23,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-45a567cdce39d10269b1f910: done: 0.071446 sec","job_status":"done","queue_duration_s":0.378953,"scheduling_latency_s":0.378982,"redis_calls":7,"redis_duration_s":0.002203,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071446,"completed_at":"2026-08-11T10:00:56.244Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019127,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 344.421989] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.247Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"10fdd09850e639b665f1f99d","created_at":"2026-08-11T10:00:55.996Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-e391cbb1ecb94b83","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:56.001Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-10fdd09850e639b665f1f99d: start","job_status":"start","queue_duration_s":0.246068,"scheduling_latency_s":0.246097} gitlab # [ 344.438480] gitaly[909]: time="2026-08-11T10:00:56.149Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4957DRFP7WC2E5X1C700S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:01:26.147" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:00:56.147" grpc.time_ms=1.164 pid=909 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7f3c80af95af72a8d0871ce61310ae60630dae53/statuses, in 0.23 seconds) (finished: subtest: eval and build post commit statuses, in 7.78 seconds) gitlab # [ 344.450831] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.289Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"10fdd09850e639b665f1f99d","created_at":"2026-08-11T10:00:55.996Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-e391cbb1ecb94b83","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:56.001Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-10fdd09850e639b665f1f99d: done: 0.041395 sec","job_status":"done","queue_duration_s":0.246068,"scheduling_latency_s":0.246097,"redis_calls":7,"redis_duration_s":0.001348,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000372,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041395,"completed_at":"2026-08-11T10:00:56.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} (finished: run the VM test script, in 414.61 seconds) gitlab # [ 344.493483] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"56920fdba4d651d870c0e7bf","created_at":"2026-08-11T10:00:56.016Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-e391cbb1ecb94b83","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:56.027Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-56920fdba4d651d870c0e7bf: start","job_status":"start","queue_duration_s":0.262818,"scheduling_latency_s":0.26284} test script finished in 414.66s cleanup kill QemuMachine (pid 46) gitlab # [ 344.509217] sidekiq-cluster[2024]: {"severity":"INFO","time":"2026-08-11T10:00:56.335Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"56920fdba4d651d870c0e7bf","created_at":"2026-08-11T10:00:56.016Z","trace_propagation_headers":{"sentry-trace":"952c2f9aa3cc4546bc8e40778263a822-e391cbb1ecb94b83","baggage":"sentry-trace_id=952c2f9aa3cc4546bc8e40778263a822,sentry-release=Unknown"},"correlation_id":"01KZR4957DRFP7WC2E5X1C700S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T10:00:56.027Z","job_size_bytes":3,"pid":2024,"sidekiq_tid":"mk1o","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-56920fdba4d651d870c0e7bf: done: 0.045203 sec","job_status":"done","queue_duration_s":0.262818,"scheduling_latency_s":0.26284,"redis_calls":7,"redis_duration_s":0.001832,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) gitlab # r (finished: cleanup, in 1.45 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-11T10:00:41.888Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-11T10:00:48.488536Z', 'started_at': None, 'finished_at': None}] [] [{'id': 3, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:00:49.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 3, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:00:49.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 3, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:00:49.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 3, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:00:49.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 3, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T10:00:49.165Z', 'started_at': None, 'finished_at': '2026-08-11T10:00:54.495Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T10:00:54.896Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 3, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T10:00:49.165Z', 'started_at': None, 'finished_at': '2026-08-11T10:00:54.495Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '7f3c80af95af72a8d0871ce61310ae60630dae53', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-11T10:00:54.896Z', 'started_at': None, 'finished_at': '2026-08-11T10:00:55.113Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]