tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.LyZJ94POnc', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 72.02 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: 57c7e8d4-c45d-4610-8d63-01f6d6f891e5 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/j81yqq13z8am9lck6fpc5n3a4w1ab983-nixos-system-gitlab-test/init regInfo=/nix/store/d1whjn8xmv33qa1ahv0sv7sh23xdxj0b-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/d1whjn8xmv33qa1ahv0sv7sh23xdxj0b-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000028] arm-pv: using stolen time PV gitlab # [ 0.000384] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000546] Console: colour dummy device 80x25 gitlab # [ 0.000552] printk: legacy console [tty0] enabled gitlab # [ 0.000728] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000735] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000819] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000948] landlock: Up and running. gitlab # [ 0.000951] Yama: becoming mindful. gitlab # [ 0.001363] LSM support for eBPF active gitlab # [ 0.001569] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001668] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002789] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003471] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003475] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003629] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004617] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004711] EFI services will not be available. gitlab # [ 0.004879] smp: Bringing up secondary CPUs ... gitlab # [ 0.005511] Detected PIPT I-cache on CPU1 gitlab # [ 0.005606] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005728] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.005849] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.006866] Detected PIPT I-cache on CPU2 gitlab # [ 0.006971] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007093] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.007218] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008305] Detected PIPT I-cache on CPU3 gitlab # [ 0.008418] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008540] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.008663] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009165] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009193] SMP: Total of 4 processors activated. gitlab # [ 0.009195] CPU: All CPU(s) started at EL1 gitlab # [ 0.009205] CPU features: detected: Branch Target Identification gitlab # [ 0.009208] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009211] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009215] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009218] CPU features: detected: Common not Private translations gitlab # [ 0.009222] CPU features: detected: CRC32 instructions gitlab # [ 0.009224] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009228] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009231] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009233] CPU features: detected: E0PD gitlab # [ 0.009236] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009239] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009242] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009245] CPU features: detected: Fine Grained Traps gitlab # [ 0.009249] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009253] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009255] CPU features: detected: LSE atomic instructions gitlab # [ 0.009258] CPU features: detected: Privileged Access Never gitlab # [ 0.009261] CPU features: detected: PMUv3 gitlab # [ 0.009263] CPU features: detected: RAS Extension Support gitlab # [ 0.009266] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009269] CPU features: detected: Random Number Generator gitlab # [ 0.009271] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009274] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009277] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009280] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009406] alternatives: applying system-wide alternatives gitlab # [ 0.012232] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012400] Memory: 5963784K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.013816] devtmpfs: initialized gitlab # [ 0.017793] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.017860] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018055] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018060] 0 pages in range for non-PLT usage gitlab # [ 0.018061] 508288 pages in range for PLT usage gitlab # [ 0.018174] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.018944] DMI not present or invalid. gitlab # [ 0.022101] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.024705] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.024976] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.026826] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.026846] audit: initializing netlink subsys (disabled) gitlab # [ 0.027153] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.027621] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.027624] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.027629] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.027631] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.027634] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.027720] cpuidle: using governor ladder gitlab # [ 0.027744] cpuidle: using governor menu gitlab # [ 0.027932] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.028145] ASID allocator initialised with 65536 entries gitlab # [ 0.029286] Serial: AMBA PL011 UART driver gitlab # [ 0.034337] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.034653] printk: console [ttyAMA0] enabled gitlab # [ 0.046235] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.046242] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.046245] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.046248] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.046250] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.046253] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.046256] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.046259] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059394] fbcon: Taking over console gitlab # [ 0.059425] ACPI: Interpreter disabled. gitlab # [ 0.062033] iommu: Default domain type: Translated gitlab # [ 0.062040] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.091326] SCSI subsystem initialized gitlab # [ 0.091849] usbcore: registered new interface driver usbfs gitlab # [ 0.091885] usbcore: registered new interface driver hub gitlab # [ 0.091911] usbcore: registered new device driver usb gitlab # [ 0.092355] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.092360] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.092391] PTP clock support registered gitlab # [ 0.092449] EDAC MC: Ver: 3.0.0 gitlab # [ 0.092909] scmi_core: SCMI protocol bus registered gitlab # [ 0.093705] FPGA manager framework gitlab # [ 0.094619] vgaarb: loaded gitlab # [ 0.096335] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.103887] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.103943] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.105720] netfs: FS-Cache loaded gitlab # [ 0.106372] pnp: PnP ACPI: disabled gitlab # [ 0.116485] NET: Registered PF_INET protocol family gitlab # [ 0.118955] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.171650] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.171722] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.171788] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.172195] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.173072] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.173207] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.173278] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.173452] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.173734] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.173765] NET: Registered PF_XDP protocol family gitlab # [ 0.173788] PCI: CLS 0 bytes, default 64 gitlab # [ 0.174065] Trying to unpack rootfs image as initramfs... gitlab # [ 0.180936] kvm [1]: HYP mode not available gitlab # [ 0.249057] Initialise system trusted keyrings gitlab # [ 0.249546] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.252033] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.252246] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.290372] Key type asymmetric registered gitlab # [ 0.290401] Asymmetric key parser 'x509' registered gitlab # [ 0.290665] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.291045] io scheduler mq-deadline registered gitlab # [ 0.291060] io scheduler kyber registered gitlab # [ 0.304425] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.308552] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.309771] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.309824] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.309853] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.309870] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.309931] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.309999] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.310194] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.310213] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.310246] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.310257] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.310267] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.310497] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.311915] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.312609] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.312647] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.312729] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.312776] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.314574] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.315211] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.315247] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.315327] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.317042] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.317639] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.317675] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.317765] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.319300] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.319900] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.319937] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.320044] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.321886] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.322502] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.322538] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.322617] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.324115] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.324839] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.324875] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.324955] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.326613] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.327233] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.327281] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.327361] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.327398] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.329037] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.329676] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.329757] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.331223] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.331854] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.331936] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.333257] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.333906] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.334687] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.335394] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.335431] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.335520] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.337070] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.337690] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.337725] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.337806] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.339634] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.339652] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.339663] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.339794] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.339948] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.340093] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.340223] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.340406] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.340540] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.340673] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.340803] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.340951] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.341168] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.341353] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.341408] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.341460] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.341514] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.341567] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.341621] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.341675] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.341729] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.341783] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.341838] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.341904] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.341962] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.342028] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.342082] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.342145] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.342199] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.342252] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.342305] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.342357] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.342413] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.342466] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.342530] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.342546] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.342555] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.346866] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.376286] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.379996] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.383538] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.388090] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.393032] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.396571] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.401210] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.406064] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.409696] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.414262] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.419324] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.428304] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.431600] msm_serial: driver initialized gitlab # [ 0.431931] SuperH (H)SCI(F) driver initialized gitlab # [ 0.432052] STM32 USART driver initialized gitlab # [ 0.475025] loop: module loaded gitlab # [ 0.475570] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.480607] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.485444] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.490326] virtio_blk virtio5: [vdb] 12227520 512-byte logical blocks (6.26 GB/5.83 GiB) gitlab # [ 0.495483] megasas: 07.734.00.00-rc1 gitlab # [ 0.497462] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.503833] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.503873] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.508626] Using buffer write method gitlab # [ 0.508741] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.513211] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.513242] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.517226] Using buffer write method gitlab # [ 0.517260] Concatenating MTD devices: gitlab # [ 0.517267] (0): "0.flash" gitlab # [ 0.517274] (1): "0.flash" gitlab # [ 0.517280] into device "0.flash" gitlab # [ 0.600094] Freeing initrd memory: 27184K gitlab # [ 0.617839] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.625981] thunder_xcv, ver 1.0 gitlab # [ 0.626080] thunder_bgx, ver 1.0 gitlab # [ 0.626135] nicpf, ver 1.0 gitlab # [ 0.627736] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.627746] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.627810] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.627824] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.627933] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.628024] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.628101] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.628111] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.628599] sky2: driver version 1.30 gitlab # [ 0.633406] usbcore: registered new interface driver usb-storage gitlab # [ 0.633549] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.633600] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.633724] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.633770] usbserial: USB Serial support registered for generic gitlab # [ 0.634224] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.635449] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.637944] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.638020] rtc-pl031 9010000.pl031: setting system clock to 2026-08-16T17:55:28 UTC (1786902928) gitlab # [ 0.638867] i2c_dev: i2c /dev entries driver gitlab # [ 0.644431] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.645705] hub 1-0:1.0: USB hub found gitlab # [ 0.645750] hub 1-0:1.0: 6 ports detected gitlab # [ 0.647318] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.647333] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.648164] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.649337] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.654093] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.654952] usbcore: registered new interface driver usbhid gitlab # [ 0.654963] usbhid: USB HID core driver gitlab # [ 0.681630] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.686360] drop_monitor: Initializing network drop monitor service gitlab # [ 0.686755] NET: Registered PF_INET6 protocol family gitlab # [ 0.688707] Segment Routing with IPv6 gitlab # [ 0.688745] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.688834] NET: Registered PF_PACKET protocol family gitlab # [ 0.689143] 9pnet: Installing 9P2000 support gitlab # [ 0.693429] Key type dns_resolver registered gitlab # [ 0.712206] registered taskstats version 1 gitlab # [ 0.712730] Loading compiled-in X.509 certificates gitlab # [ 0.736237] Demotion targets for Node 0: null gitlab # [ 0.736543] Key type .fscrypt registered gitlab # [ 0.736552] Key type fscrypt-provisioning registered gitlab # [ 0.736729] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.736753] ima: Allocated hash algorithm: sha1 gitlab # [ 0.736782] ima: No architecture policies found gitlab # [ 0.737940] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.767530] clk: Disabling unused clocks gitlab # [ 0.767560] PM: genpd: Disabling unused power domains gitlab # [ 0.773226] Freeing unused kernel memory: 4736K gitlab # [ 0.773467] Run /init as init process gitlab # [ 0.798497] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.892377] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.047073] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.132825] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.132891] systemd[1]: Detected virtualization qemu. gitlab # [ 1.132967] systemd[1]: Detected architecture arm64. gitlab # [ 1.132983] systemd[1]: Running in initrd. gitlab # [ 1.133800] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.134053] systemd[1]: Hostname set to . gitlab # [ 1.136946] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.256402] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.349831] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.418670] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.419285] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.468951] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.485087] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.485489] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.485545] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.485565] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.485602] systemd[1]: Reached target Path Units. gitlab # [ 1.485632] systemd[1]: Reached target Slice Units. gitlab # [ 1.485664] systemd[1]: Reached target Swaps. gitlab # [ 1.485694] systemd[1]: Reached target Timer Units. gitlab # [ 1.486016] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.486281] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.486532] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.486768] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.486920] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.486956] systemd[1]: Reached target Socket Units. gitlab # [ 1.489709] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.492374] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.492478] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.496568] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.525750] systemd[1]: Starting Journal Service... gitlab # [ 1.529708] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.529940] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.533315] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.539611] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.545249] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.548973] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.552523] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.562946] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.563133] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.563145] [drm] features: -context_init gitlab # [ 1.564196] [drm] number of scanouts: 1 gitlab # [ 1.564221] [drm] number of cap sets: 0 gitlab # [ 1.568597] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.570809] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.576532] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.580882] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.580909] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.590325] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.591389] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.599273] systemd-journald[94]: Collecting audit messages is disabled. gitlab # [ 1.612307] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.616528] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.641903] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.646887] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.651262] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.684949] systemd[1]: Started Journal Service. gitlab # [ 1.680690] systemd-modules-load[95]: Using 4 probe threads gitlab # [ 1.685494] systemd-modules-load[95]: Module 'virtio_balloon' is built in gitlab # [ 1.689116] systemd-modules-load[95]: Module 'virtio_console' is built in gitlab # [ 1.692571] systemd-modules-load[95]: Module 'virtio_rng' is built in gitlab # [ 1.695739] systemd-modules-load[95]: Inserted module 'dm_mod' gitlab # [ 1.698921] systemd-modules-load[95]: Inserted module 'virtio_gpu' gitlab # [ 1.702026] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.705214] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.708531] systemd[1]: Reached target Local File Systems. gitlab # [ 1.710761] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.713454] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.755394] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.770927] systemd-udevd[113]: Using default interface naming scheme 'v261'. gitlab # [ 1.790454] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.815992] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.886564] systemd-vconsole-setup[132]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.894046] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.154752] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.156186] systemd[1]: Reached target System Initialization. gitlab # [ 2.157015] systemd[1]: Reached target Basic System. gitlab # [ 2.336411] (udev-worker)[147]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.351994] (udev-worker)[123]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.358421] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.370181] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.373638] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.375676] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.393863] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.424388] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.430139] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.532809] systemd[1]: Mounting /sysroot... gitlab # [ 2.569622] EXT4-fs (vda): mounted filesystem 57c7e8d4-c45d-4610-8d63-01f6d6f891e5 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.569708] systemd[1]: Mounted /sysroot. gitlab # [ 2.570475] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.575799] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.576853] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.590312] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.596242] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.600770] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.613557] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.614754] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.615532] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.616343] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.618667] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.628887] systemd-sysroot-fstab-check[167]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.638711] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.644856] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.650711] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.656122] systemd[1]: Reload requested from client PID 167 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.658270] systemd[1]: Reloading... gitlab # [ 2.765202] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.823364] systemd[1]: Reloading finished in 165 ms. gitlab # [ 2.871647] systemd-sysroot-fstab-check[167]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.874319] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.875680] systemd-sysroot-fstab-check[167]: Requesting swap.target/start/replace... gitlab # [ 2.877747] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.880473] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.881480] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.882441] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.903115] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.904205] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.963133] (udev-worker)[148]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 2.965665] (udev-worker)[148]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 2.970475] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 2.972212] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 2.973103] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 2.973870] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.006610] systemd-vconsole-setup[199]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.009359] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.537992] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.614108] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.616430] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.618795] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.621427] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.659563] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.663246] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.679879] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.682601] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.685224] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.744319] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.746924] systemd[1]: Stopped target Basic System. gitlab # [ 3.749236] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.751591] systemd[1]: Stopped target Path Units. gitlab # [ 3.753892] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.757237] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.760543] systemd[1]: Stopped target Slice Units. gitlab # [ 3.762716] systemd[1]: Stopped target Socket Units. gitlab # [ 3.765014] systemd[1]: Stopped target System Initialization. gitlab # [ 3.767453] systemd[1]: Stopped target Swaps. gitlab # [ 3.770772] systemd[1]: Stopped target Timer Units. gitlab # [ 3.773138] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.775588] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.778291] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.781752] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.784365] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.787032] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.789525] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.792165] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.794271] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.797235] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.799386] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.802669] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.806068] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.808933] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.811259] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.813239] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.815454] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.817764] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.819450] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.821657] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.823702] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.826383] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.828207] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.829954] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.831875] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.833554] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.835478] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.837240] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.839184] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.841221] systemd[1]: systemd-udevd.service: Consumed 2.278s CPU time over 2.101s wall clock time, 30.7M memory peak. gitlab # [ 3.843890] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.845888] systemd[1]: Closed udev Control Socket. gitlab # [ 3.847212] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.848977] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.851036] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.852827] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.854968] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.856926] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.858769] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.917694] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.920997] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.922644] systemd[1]: Reached target Switch Root. gitlab # [ 3.924222] systemd[1]: Starting NixOS Activation... gitlab # [ 4.124578] initrd-nixos-activation-start[224]: booting system configuration /nix/store/j81yqq13z8am9lck6fpc5n3a4w1ab983-nixos-system-gitlab-test gitlab # [ 4.187683] initrd-nixos-activation-start[224]: running activation script... gitlab # [ 4.489628] initrd-nixos-activation-start[247]: setting up /etc... gitlab # [ 4.642204] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.645708] systemd[1]: Finished NixOS Activation. gitlab # [ 4.647806] systemd[1]: Starting Switch Root... gitlab # [ 4.703757] systemd[1]: Switching root. gitlab # [ 4.805087] systemd-journald[94]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.450358] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.450497] systemd[1]: Detected virtualization qemu. gitlab # [ 5.450572] systemd[1]: Detected architecture arm64. gitlab # [ 5.450747] systemd[1]: Detected first boot. gitlab # [ 5.452094] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.707864] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.818403] systemd[1]: Applying preset policy. gitlab # [ 6.008897] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.249003] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.249335] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.251311] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.258365] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.261926] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.265908] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.266616] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.267497] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.268342] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.269196] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.270097] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.270992] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.271867] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.272781] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.273669] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.274539] systemd[1]: Reached target Path Units. gitlab # [ 6.275410] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.276383] systemd[1]: Reached target Slice Units. gitlab # [ 6.277173] systemd[1]: Reached target Swaps. gitlab # [ 6.279393] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.281835] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.283452] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.285325] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.286052] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.292591] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.293990] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.296483] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.297369] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.297988] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.298649] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.302091] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.302848] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.303563] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.364654] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.370236] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.376284] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.384125] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.390025] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.404657] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.409085] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.424524] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.425166] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.425601] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.436678] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.437718] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.449051] systemd[1]: Starting Journal Service... gitlab # [ 6.453954] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.460538] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.467284] fuse: init (API version 7.45) gitlab # [ 6.468901] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.472490] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.484521] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.495988] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.497090] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.497973] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.498771] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.499533] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.500804] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.501843] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.502774] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.503600] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.504589] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.505657] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.524838] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.510796] EXT4-fs (vda): re-mounted 57c7e8d4-c45d-4610-8d63-01f6d6f891e5. gitlab # [ 6.512998] systemd-journald[318]: Collecting audit messages is enabled. gitlab # [ 6.513834] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.528968] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.533332] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.534639] systemd-modules-load[319]: Using 3 probe threads gitlab # [ 6.535570] systemd-modules-load[319]: Module 'atkbd' is built in gitlab # [ 6.536631] systemd-modules-load[319]: Module 'loop' is built in gitlab # [ 6.537614] systemd-modules-load[319]: Inserted module 'tls' gitlab # [ 6.543460] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.552687] systemd[1]: Started Journal Service. gitlab # [ 6.555334] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.556784] systemd-oomd[320]: No swap; memory pressure usage will be degraded gitlab # [ 6.558292] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.559531] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.560717] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.567707] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.570846] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.573211] systemd[1]: Starting Firewall... gitlab # [ 6.576246] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.577815] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.598122] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.604207] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.613999] systemd-journald[318]: Received client request to flush runtime journal. gitlab # [ 6.657656] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.659211] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.663444] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.665608] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.667498] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.668894] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.670298] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.671828] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.673548] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.726254] systemd-udevd[353]: Using default interface naming scheme 'v261'. gitlab # [ 6.763231] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.069776] systemd[1]: Finished Firewall. gitlab # [ 7.115598] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.191420] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.244808] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.251396] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.284940] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.289130] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.292243] systemd[1]: Reached target Local File Systems. gitlab # [ 7.293319] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.300718] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.304048] (udev-worker)[470]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.306570] (udev-worker)[470]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.308394] (udev-worker)[395]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.312623] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.314236] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.324453] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.327918] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.344972] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.346609] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.350417] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.352242] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.356261] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.360085] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.362033] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.386659] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.388413] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.390553] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.401984] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.404467] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.438577] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.448516] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.446544] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.448315] systemd[1]: Starting Update is Completed... gitlab # [ 7.469506] systemd[1]: Finished Update is Completed. gitlab # [ 7.496410] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.497714] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.498544] systemd[1]: suid-sgid-wrappers.service: Consumed 126ms CPU time over 185ms wall clock time, 6.3M memory peak, 1.9M read from disk. gitlab # [ 7.750149] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.752360] systemd[1]: Reached target System Initialization. gitlab # [ 7.753457] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.754449] systemd[1]: Started logrotate.timer. gitlab # [ 7.755171] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.756270] systemd[1]: Reached target Timer Units. gitlab # [ 7.757019] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.757956] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.769675] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.770595] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.771822] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.773008] systemd[1]: Reached target Socket Units. gitlab # [ 7.775203] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.806903] dbus-broker-launch[561]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.808904] dbus-broker-launch[561]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.810457] dbus-broker-launch[561]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.813260] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.823000] dbus-broker-launch[561]: Ready gitlab # [ 7.823741] systemd[1]: Reached target Basic System. gitlab # [ 7.826366] systemd[1]: Started backdoor.service. gitlab # [ 7.848316] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.855981] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.857451] systemd[1]: Starting Logrotate configuration check... gitlab # connecting to host... gitlab # [ 7.865512] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab: connected to guest root shell gitlab # [ 7.892280] systemd[1]: Starting Post-Boot Actions... gitlab: (connecting took 8.34 seconds) gitlab # [ 7.897181] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab: (finished: waiting for the VM to finish booting, in 8.34 seconds) gitlab # [ 7.895583] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.898283] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # [ 7.899418] logrotate[568]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.900484] logrotate[568]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.901519] logrotate[568]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.902453] logrotate[568]: Allocating hash table for state file, size 64 entries gitlab # [ 7.903454] logrotate[568]: Handling 4 logs gitlab # [ 7.904109] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.906146] logrotate[568]: considering log /var/log/btmp gitlab # [ 7.906900] logrotate[568]: Creating new state gitlab # [ 7.907688] logrotate[568]: Now: 2026-08-16 17:55 gitlab # [ 7.908465] logrotate[568]: Last rotated at 2026-08-16 17:00 gitlab # [ 7.909243] logrotate[568]: log does not need rotating (log has already been rotated) gitlab # [ 7.910283] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.914984] logrotate[568]: considering log /var/log/wtmp gitlab # [ 7.915783] logrotate[568]: Creating new state gitlab # [ 7.916483] logrotate[568]: Now: 2026-08-16 17:55 gitlab # [ 7.917134] logrotate[568]: Last rotated at 2026-08-16 17:00 gitlab # [ 7.917896] logrotate[568]: log does not need rotating (log has already been rotated) gitlab # [ 7.918913] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.922761] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568) gitlab # [ 7.923863] logrotate[568]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.924832] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.925864] logrotate[568]: Creating new state gitlab # [ 7.926524] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568) gitlab # [ 7.927700] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.929575] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568) gitlab # [ 7.930625] logrotate[568]: considering log /var/log/nginx/*.log gitlab # [ 7.931388] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.933492] logrotate[568]: Creating new state gitlab # [ 7.934098] logrotate[568]: not running postrotate script, since no logs were rotated gitlab # [ 7.935086] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568) gitlab # [ 7.936231] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.939111] systemd[1]: Starting resolvconf update... gitlab # [ 7.940113] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.941320] nsncd[571]: Aug 16 17:55:35.794 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.943622] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.944601] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.945707] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.946685] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.947605] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.949303] systemd[1]: Starting User Login Management... gitlab # [ 8.021059] systemd-logind[605]: New seat seat0. gitlab # [ 8.027604] systemd-logind[605]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.029055] systemd-logind[605]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.030157] systemd[1]: Started User Login Management. gitlab # [ 8.032516] systemd[1]: Starting linger-users.service... gitlab # [ 8.036810] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.037863] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.039043] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.041156] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.042067] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.044165] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.045060] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.045924] systemd[1]: nscd.service: Consumed 26ms CPU time over 178ms wall clock time, 7.8M memory peak, 5.8M read from disk. gitlab # [ 8.059777] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.062801] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.063836] systemd[1]: Finished linger-users.service. gitlab # [ 8.079819] nsncd[661]: Aug 16 17:55:35.945 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.082937] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.083914] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.087289] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.104147] systemd[1]: Finished resolvconf update. gitlab # [ 8.110637] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.114669] systemd[1]: Starting DHCP Client... gitlab # [ 8.117576] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.120961] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.134315] systemd-logind[605]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.149096] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.178326] network-addresses-eth1-start[690]: adding address 192.168.1.1/24... done gitlab # [ 8.185864] network-addresses-eth1-start[690]: adding address 2001:db8:1::1/64... done gitlab # [ 8.195128] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.218160] systemd-vconsole-setup[692]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.220975] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.229949] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.230906] systemd[1]: Reached target Network. gitlab # [ 8.233467] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.235951] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.244183] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.247279] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.252097] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.253251] dhcpcd[715]: dhcpcd-10.3.2 starting gitlab # [ 8.256471] dhcpcd[763]: dev: loaded udev gitlab # [ 8.271699] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.272136] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.288340] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.289711] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.299081] systemd[1]: Started Getty on tty1. gitlab # [ 8.299858] systemd[1]: Reached target Login Prompts. gitlab # [ 8.333304] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.340139] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.340759] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.342869] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.343203] cfg80211: failed to load regulatory.db gitlab # [ 8.379717] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.377529] dhcpcd[763]: eth0: waiting for carrier gitlab # [ 8.378330] dhcpcd[763]: eth0: carrier acquired gitlab # [ 8.380097] dhcpcd[763]: DUID 00:01:00:01:32:14:b6:18:52:54:00:12:34:56 gitlab # [ 8.381167] dhcpcd[763]: eth0: IAID 00:12:34:56 gitlab # [ 8.381800] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.406290] nginx-pre-start[782]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.408061] nginx-pre-start[782]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.413074] systemd[1]: Started Nginx Web Server. gitlab # [ 8.428951] postgresql-pre-start[783]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.430664] postgresql-pre-start[783]: This user must also own the server process. gitlab # [ 8.434090] postgresql-pre-start[783]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.435486] postgresql-pre-start[783]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.438111] postgresql-pre-start[783]: The default text search configuration will be set to "english". gitlab # [ 8.439842] postgresql-pre-start[783]: Data page checksums are enabled. gitlab # [ 8.442981] postgresql-pre-start[783]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.444991] postgresql-pre-start[783]: creating subdirectories ... ok gitlab # [ 8.446309] postgresql-pre-start[783]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.459448] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.462373] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.463472] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started gitlab # [ 8.468327] redis-server[787]: Configuration loaded gitlab # [ 8.469281] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.470170] redis[787]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.471243] redis[787]: Running mode=standalone, port=0. gitlab # [ 8.472251] redis[787]: Server initialized gitlab # [ 8.473004] redis[787]: Ready to accept connections unix gitlab # [ 8.474097] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.478191] postgresql-pre-start[783]: selecting default "max_connections" ... 100 gitlab # [ 8.526050] postgresql-pre-start[783]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.853484] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.972725] postgresql-pre-start[783]: selecting default time zone ... UTC gitlab # [ 8.975854] postgresql-pre-start[783]: creating configuration files ... ok gitlab # [ 9.215705] gitlab-workhorse[819]: time="2026-08-16T17:55:37Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.217519] gitlab-workhorse[819]: time="2026-08-16T17:55:37Z" level=info msg="Using redis/go-redis" gitlab # [ 9.218753] gitlab-workhorse[819]: time="2026-08-16T17:55:37Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.236134] postgresql-pre-start[783]: running bootstrap script ... ok gitlab # [ 9.575510] dhcpcd[763]: eth0: soliciting a DHCP lease gitlab # [ 9.585146] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.608636] dhcpcd[763]: eth0: probing address 10.0.2.15/24 gitlab # [ 9.867677] postgresql-pre-start[783]: performing post-bootstrap initialization ... ok gitlab # [ 10.064273] dhcpcd[763]: eth0: soliciting an IPv6 router gitlab # [ 10.067919] dhcpcd[763]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.073191] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.078211] dhcpcd[763]: eth0: adding route to fec0::/64 gitlab # [ 10.081644] dhcpcd[763]: eth0: adding default route via fe80::2 gitlab # [ 10.163717] postgresql-pre-start[783]: syncing data to disk ... ok gitlab # [ 10.166727] postgresql-pre-start[783]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.171075] postgresql-pre-start[783]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.178152] postgresql-pre-start[783]: Success. You can now start the database server using: gitlab # [ 10.181877] postgresql-pre-start[783]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.346787] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.352598] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.355907] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.359503] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.371203] postgres[863]: [863] LOG: database system was shut down at 2026-08-16 17:55:37 GMT gitlab # [ 10.383044] postgres[854]: [854] LOG: database system is ready to accept connections gitlab # [ 10.396505] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.399638] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.640188] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 10.644398] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 10.751567] systemd[1]: Finished gitlab-config.service. gitlab # [ 10.758161] postgresql-setup-start[879]: CREATE DATABASE gitlab # [ 10.760422] systemd[1]: Started gitaly.service. gitlab # [ 10.812509] postgresql-setup-start[898]: CREATE ROLE gitlab # [ 10.837683] postgresql-setup-start[900]: ALTER DATABASE gitlab # [ 10.896919] postgresql-setup-start[905]: CREATE ROLE gitlab # [ 10.900880] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 10.903463] systemd[1]: Reached target PostgreSQL. gitlab # [ 10.908601] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 10.912992] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.098141] gitlab-postgresql-start[920]: CREATE DATABASE gitlab # [ 11.174962] gitlab-postgresql-start[930]: CREATE EXTENSION gitlab # [ 11.284697] gitlab-postgresql-start[937]: CREATE EXTENSION gitlab # [ 11.294616] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 11.388822] gitaly[893]: time="2026-08-16T17:55:39.253Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=893 gitlab # [ 11.409194] gitaly[893]: time="2026-08-16T17:55:39.254Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=893 gitlab # [ 11.420194] gitaly[893]: time="2026-08-16T17:55:39.254Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=893 gitlab # [ 11.426939] gitaly[893]: time="2026-08-16T17:55:39.255Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=893 gitlab # [ 11.433966] gitaly[893]: time="2026-08-16T17:55:39.255Z" level=info msg="Starting Gitaly" pid=893 version= gitlab # [ 11.631235] gitaly[893]: time="2026-08-16T17:55:39.497Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=241 pid=893 gitlab # [ 11.633792] gitaly[893]: time="2026-08-16T17:55:39.497Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=893 gitlab # [ 11.635854] gitaly[893]: time="2026-08-16T17:55:39.497Z" level=info msg="finished initializing command factory" duration_ms=0 pid=893 gitlab # [ 11.638242] gitaly[893]: time="2026-08-16T17:55:39.497Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-893/git-exec-2740147628.d/git pid=893 gitlab # [ 11.640855] gitaly[893]: time="2026-08-16T17:55:39.502Z" level=info msg="finished detecting git version" duration_ms=4 pid=893 gitlab # [ 11.642848] gitaly[893]: time="2026-08-16T17:55:39.502Z" level=info msg="using Git version" pid=893 version=2.53.g gitlab # [ 11.644755] gitaly[893]: time="2026-08-16T17:55:39.502Z" level=info msg="clearing disk cache object folder" pid=893 storage=default gitlab # [ 11.646794] gitaly[893]: time="2026-08-16T17:55:39.503Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3757985619 pid=893 storage=default gitlab # [ 11.650417] gitaly[893]: time="2026-08-16T17:55:39.503Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3757985619 pid=893 storage=default gitlab # [ 11.654121] gitaly[893]: time="2026-08-16T17:55:39.503Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=893 gitlab # [ 11.657304] gitaly[893]: time="2026-08-16T17:55:39.503Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=893 gitlab # [ 11.660548] gitaly[893]: time="2026-08-16T17:55:39.503Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3757985619 clear_duration_ms=0 pid=893 storage=default gitlab # [ 11.663825] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="counting repositories" pid=893 gitlab # [ 11.665509] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="starting to count repositories" pid=893 storage_path=/var/gitlab/state/repositories gitlab # [ 11.667772] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=893 storage_path=/var/gitlab/state/repositories gitlab # [ 11.670395] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="completed counting all repositories" counting_duration=0 pid=893 gitlab # [ 11.672350] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=893 gitlab # [ 11.674799] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="finished tempdir cleaner walk" pid=893 storage=default time_ms=0 gitlab # [ 11.676780] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=893 schema=unix gitlab # [ 11.679051] gitaly[893]: time="2026-08-16T17:55:39.519Z" level=info msg="listening at address" address=/run/gitaly/gitaly-893/sock.d/intern pid=893 schema=unix gitlab # [ 11.681468] gitaly[893]: time="2026-08-16T17:55:39.521Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=893 gitlab # [ 11.683264] gitaly[893]: time="2026-08-16T17:55:39.521Z" level=info msg="Started Gitaly" duration_ms=265 pid=893 gitlab # [ 11.685207] gitaly[893]: time="2026-08-16T17:55:39.521Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=893 gitlab # [ 11.687861] gitaly[893]: time="2026-08-16T17:55:39.521Z" level=info msg="maintenance: daily scheduled" pid=893 scheduled="2026-08-17 12:00:00 +0000 UTC" gitlab # [ 12.102309] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.112587] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.123004] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.950030] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.950346] dhcpcd[763]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.950549] dhcpcd[763]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.140370] systemd[1]: Started DHCP Client. gitlab # [ 14.148974] systemd[1]: Reached target Network is Online. gitlab # [ 15.105627] gitaly[893]: time="2026-08-16T17:55:42.970Z" level=info msg="License database preloaded" duration_ms=3715 pid=893 gitlab # [ 56.881123] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[915]: W, [2026-08-16T17:56:24.745753 #915] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.291536] gitlab-workhorse[819]: time="2026-08-16T17:56:27Z" level=error correlation_id= duration_ms=2 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 60.719456] postgres[1437]: [1437] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 60.719912] postgres[1437]: [1437] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 60.720111] postgres[1437]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 60.720244] postgres[1437]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 60.720359] postgres[1437]: attidentity AS identity, gitlab # [ 60.720477] postgres[1437]: attgenerated as attgenerated gitlab # [ 60.720592] postgres[1437]: FROM pg_attribute a gitlab # [ 60.720709] postgres[1437]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 60.720850] postgres[1437]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 60.720952] postgres[1437]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 60.721065] postgres[1437]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 60.721180] postgres[1437]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 60.721293] postgres[1437]: ORDER BY a.attnum gitlab # [ 60.721412] postgres[1437]: gitlab # [ 65.815363] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1488]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 65.815794] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1488]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.298212] gitlab-workhorse[819]: time="2026-08-16T17:56:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.306344] gitlab-workhorse[819]: time="2026-08-16T17:56:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.306902] gitlab-workhorse[819]: time="2026-08-16T17:56:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 91.415468] postgres[1591]: [1591] ERROR: relation "table_without_models" does not exist gitlab # [ 91.415882] postgres[1591]: [1591] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.318215] gitlab-workhorse[819]: time="2026-08-16T17:57:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.328600] gitlab-workhorse[819]: time="2026-08-16T17:57:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.338156] gitlab-workhorse[819]: time="2026-08-16T17:57:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 122.468704] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 122.481344] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 122.492375] systemd[1]: Starting gitlab.service... gitlab # [ 123.061691] bundle[1974]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 123.062215] bundle[1974]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 123.063524] bundle[1974]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 127.634569] sidekiq-cluster[1972]: {"severity":"INFO","time":"2026-08-16T17:57:35.462Z","message":"Starting cluster with 1 processes"} gitlab # [ 127.661813] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.497Z","pid":1974,"message":"* Enabling systemd notification integration"} gitlab # [ 127.666823] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"Puma starting in cluster mode..."} gitlab # [ 127.671368] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 127.676323] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 127.682537] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Min threads: 0"} gitlab # [ 127.686566] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Max threads: 4"} gitlab # [ 127.690608] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Environment: production"} gitlab # [ 127.694845] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Master PID: 1974"} gitlab # [ 127.698894] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Workers: 2"} gitlab # [ 127.702855] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 127.707974] bundle[1974]: {"timestamp":"2026-08-16T17:57:35.527Z","pid":1974,"message":"* Preloading application"} gitlab # [ 129.341246] gitlab-workhorse[819]: time="2026-08-16T17:57:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.341256] gitlab-workhorse[819]: time="2026-08-16T17:57:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.350202] gitlab-workhorse[819]: time="2026-08-16T17:57:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.358323] gitlab-workhorse[819]: time="2026-08-16T17:58:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 165.183024] bundle[1974]: W, [2026-08-16T17:58:13.048030 #1974] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.361403] gitlab-workhorse[819]: time="2026-08-16T17:58:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 169.761075] sidekiq-cluster[2014]: 2026-08-16T17:58:17.625Z pid=2014 tid=wom INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2014, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>426627072} gitlab # [ 170.036175] sidekiq-cluster[2014]: W, [2026-08-16T17:58:17.899343 #2014] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 170.175538] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:18.041Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 173.306881] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.171Z","message":"GitLab reliable fetch activated!"} gitlab # [ 173.312174] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.172Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 173.339105] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.205Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 173.346206] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.208Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 173.353344] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.211Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 173.359940] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.213Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 173.366943] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.216Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 173.372609] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.219Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 173.377909] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.221Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 173.382401] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.223Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 173.386634] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.225Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 173.390709] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.227Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 173.394958] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.229Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 173.398819] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.232Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 173.402223] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.234Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 173.406203] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.236Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 173.409449] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.238Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 173.412451] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.240Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 173.415181] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.243Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 173.417911] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.246Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 173.420779] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.249Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 173.423400] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.252Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 173.426419] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.254Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 173.429404] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.257Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 173.431838] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.260Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 173.434525] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.262Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 173.437066] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.264Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 173.439341] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.268Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 173.441661] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.271Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 173.443847] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.274Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 173.446244] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.277Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 173.448557] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.280Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 173.450643] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.282Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 173.452997] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.285Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 173.455010] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.287Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 173.457249] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.290Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 173.459337] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.293Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 173.461497] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.295Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 173.463527] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.297Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 173.465736] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.300Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 173.467689] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.302Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 173.469778] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.304Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 173.471918] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.306Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 173.474190] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.312Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 173.476325] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.316Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 173.478327] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.319Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 173.480494] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.322Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 173.482672] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.324Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 173.484835] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.326Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 173.486908] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.329Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 173.489035] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.331Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 173.491108] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.337Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 173.494408] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.343Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 173.496487] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.349Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 173.507532] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.373Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 173.512041] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.378Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 173.515763] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.381Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 173.519690] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.385Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 173.523205] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.389Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 173.600768] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.466Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 173.604817] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.469Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 173.608804] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.472Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 173.612446] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.476Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 173.616091] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.478Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 173.619893] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.482Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 173.624080] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.485Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 173.628100] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.488Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 173.631949] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.492Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 173.635939] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.494Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 173.640103] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.497Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 173.644160] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.499Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 173.648173] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.502Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 173.651829] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.504Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 173.655524] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.506Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 173.659046] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.508Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 173.662609] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.510Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 173.665978] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.513Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 173.669218] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.515Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 173.672099] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.517Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 173.675201] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.519Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 173.678048] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.522Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 173.680639] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.526Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 173.683364] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.530Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 173.686311] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.535Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 173.688931] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.542Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 173.691365] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.546Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 173.694022] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.551Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 173.696455] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.555Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 173.700055] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.560Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 173.702426] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.564Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 173.704825] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.567Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 173.707133] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.572Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 173.709582] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.574Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 173.712229] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.578Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 173.714709] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.580Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 173.718755] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.584Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 173.723940] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.588Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 173.728346] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.594Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 173.731520] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.597Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 173.734886] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.601Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 173.752418] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.618Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 173.755424] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.621Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 173.758562] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.624Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 173.762146] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.628Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 173.766228] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.632Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 173.769817] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.635Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 173.773508] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.639Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 173.777039] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.642Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 173.780072] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.644Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 173.783191] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.648Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 173.786350] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:58:21.651Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 179.362536] gitlab-workhorse[819]: time="2026-08-16T17:58:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.363949] gitlab-workhorse[819]: time="2026-08-16T17:58:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.376372] gitlab-workhorse[819]: time="2026-08-16T17:58:47Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 209.379003] gitlab-workhorse[819]: time="2026-08-16T17:58:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 211.338774] postgres[2450]: [2450] ERROR: relation "table_without_models" does not exist gitlab # [ 211.342459] postgres[2450]: [2450] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 215.378965] postgres[2761]: [2761] ERROR: relation "table_without_models" does not exist gitlab # [ 215.379300] postgres[2761]: [2761] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 216.137842] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:04.003Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 216.151708] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:04.017Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 216.158187] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:04.017Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 216.163650] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:04.018Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 216.169848] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:04.020Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 218.814178] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:06.678Z","message":"Cleaning working queues"} gitlab # [ 218.815988] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:06.681Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1c4ee1388692d518e06a06ea","created_at":"2026-08-16T17:57:29.797Z","trace_propagation_headers":{"sentry-trace":"3fce0732f05146ea9795854e6e852623-f94f5498c47044dc","baggage":"sentry-trace_id=3fce0732f05146ea9795854e6e852623,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"21f241b2ba2df23281de5196b1f3f85d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:57:29.809Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1c4ee1388692d518e06a06ea: start","job_status":"start","queue_duration_s":96.872124,"scheduling_latency_s":96.872228} gitlab # [ 219.185220] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:07.050Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1c4ee1388692d518e06a06ea","created_at":"2026-08-16T17:57:29.797Z","trace_propagation_headers":{"sentry-trace":"3fce0732f05146ea9795854e6e852623-f94f5498c47044dc","baggage":"sentry-trace_id=3fce0732f05146ea9795854e6e852623,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"21f241b2ba2df23281de5196b1f3f85d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:57:29.809Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1c4ee1388692d518e06a06ea: done: 0.369187 sec","job_status":"done","queue_duration_s":96.872124,"scheduling_latency_s":96.872228,"redis_calls":29,"redis_duration_s":0.01199,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007145,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003014,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.18176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19130136,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.369187,"completed_at":"2026-08-16T17:59:07.050Z","load_balancing_strategy":"primary","db_duration_s":0.099842,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 219.379990] gitlab-workhorse[819]: time="2026-08-16T17:59:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 220.891935] bundle[1974]: {"timestamp":"2026-08-16T17:59:08.756Z","pid":1974,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 220.892321] bundle[1974]: {"timestamp":"2026-08-16T17:59:08.757Z","pid":1974,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 220.892483] bundle[1974]: {"timestamp":"2026-08-16T17:59:08.757Z","pid":1974,"message":"! #\u003cThread:0x0000fcc7d476e050 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 220.892650] bundle[1974]: {"timestamp":"2026-08-16T17:59:08.757Z","pid":1974,"message":"! #\u003cThread:0x0000fcc7d4922f90 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 220.892752] bundle[1974]: {"timestamp":"2026-08-16T17:59:08.757Z","pid":1974,"message":"Use Ctrl-C to stop"} gitlab # [ 220.892862] bundle[1974]: {"timestamp":"2026-08-16T17:59:08.757Z","pid":1974,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 221.917573] bundle[1974]: {"timestamp":"2026-08-16T17:59:09.782Z","pid":1974,"message":"- Worker 1 (PID: 2865) booted in 0.97s, phase: 0"} gitlab # [ 221.919291] bundle[1974]: {"timestamp":"2026-08-16T17:59:09.783Z","pid":1974,"message":"- Worker 0 (PID: 2861) booted in 0.99s, phase: 0"} gitlab # [ 221.925400] systemd[1]: Started gitlab.service. gitlab # [ 221.926795] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 221.932230] systemd[1]: Starting setup-gitlab.service... gitlab # [ 221.971499] setup-gitlab-start[2898]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 225.234459] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:17:59:13 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 3230 gitlab # [ 225.239815] setup-gitlab-start[2898]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 225.243380] setup-gitlab-start[2898]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 225.260504] runuser[2924]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 225.814090] setup-gitlab-start[2925]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 225.820790] setup-gitlab-start[2925]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 225.827241] setup-gitlab-start[2925]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 226.627143] setup-gitlab-start[2925]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 226.627528] setup-gitlab-start[2925]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 226.629731] setup-gitlab-start[2925]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.234380] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d2a006466e5fb6824aca4587","created_at":"2026-08-16T17:59:20.000Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a5252eaa5fce8ed641b6920813cc7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.095Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d2a006466e5fb6824aca4587: start","job_status":"start","queue_duration_s":0.003251,"scheduling_latency_s":0.003312} gitlab # [ 232.676322] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d2a006466e5fb6824aca4587","created_at":"2026-08-16T17:59:20.000Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a5252eaa5fce8ed641b6920813cc7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.095Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d2a006466e5fb6824aca4587: done: 0.442268 sec","job_status":"done","queue_duration_s":0.003251,"scheduling_latency_s":0.003312,"redis_calls":14,"redis_duration_s":0.053798,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.03873,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009555,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005513,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.084,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.073,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.148093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00332004,"exclusive_lock_hold_duration_s":0.24685682,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.442268,"completed_at":"2026-08-16T17:59:20.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.108343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.772350] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0f25cd6dee1d10f57f6465f9","created_at":"2026-08-16T17:59:20.113Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf1c7dd235d46011df7b2db40364ede5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.145Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0f25cd6dee1d10f57f6465f9: start","job_status":"start","queue_duration_s":0.405963,"scheduling_latency_s":0.406012} gitlab # [ 232.995003] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0f25cd6dee1d10f57f6465f9","created_at":"2026-08-16T17:59:20.113Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf1c7dd235d46011df7b2db40364ede5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.145Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0f25cd6dee1d10f57f6465f9: done: 0.308641 sec","job_status":"done","queue_duration_s":0.405963,"scheduling_latency_s":0.406012,"redis_calls":12,"redis_duration_s":0.02355,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005117,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.146,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.146,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00163938,"exclusive_lock_hold_duration_s":0.11711378,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.308641,"completed_at":"2026-08-16T17:59:20.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.172467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.091903] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"de121c509f9018abb611260a","created_at":"2026-08-16T17:59:20.177Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d718abf262378faaa5c451706ed2b7f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.187Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-de121c509f9018abb611260a: start","job_status":"start","queue_duration_s":0.683722,"scheduling_latency_s":0.683778} gitlab # [ 233.109774] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.899Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 233.113446] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"de121c509f9018abb611260a","created_at":"2026-08-16T17:59:20.177Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d718abf262378faaa5c451706ed2b7f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.187Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-de121c509f9018abb611260a: done: 0.043424 sec","job_status":"done","queue_duration_s":0.683722,"scheduling_latency_s":0.683778,"redis_calls":10,"redis_duration_s":0.004582,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000872,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057854,"duration_s":0.043424,"completed_at":"2026-08-16T17:59:20.914Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.156726] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:20.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"df09c9ef845a64a5bec20946","created_at":"2026-08-16T17:59:20.197Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcd420f433d553621daa051381829f64","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.212Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-df09c9ef845a64a5bec20946: start","job_status":"start","queue_duration_s":0.704962,"scheduling_latency_s":0.704991} gitlab # [ 233.170778] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"df09c9ef845a64a5bec20946","created_at":"2026-08-16T17:59:20.197Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcd420f433d553621daa051381829f64","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.212Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-df09c9ef845a64a5bec20946: done: 0.083021 sec","job_status":"done","queue_duration_s":0.704962,"scheduling_latency_s":0.704991,"redis_calls":10,"redis_duration_s":0.011951999999999999,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002762,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095192,"duration_s":0.083021,"completed_at":"2026-08-16T17:59:21.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.214580] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6c8f92900f8a0a68655d7c3f","created_at":"2026-08-16T17:59:20.246Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"857f903986af26fa8f5cd33986a48a20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.265Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6c8f92900f8a0a68655d7c3f: start","job_status":"start","queue_duration_s":0.73749,"scheduling_latency_s":0.737525} gitlab # [ 233.677700] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6c8f92900f8a0a68655d7c3f","created_at":"2026-08-16T17:59:20.246Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"857f903986af26fa8f5cd33986a48a20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.265Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6c8f92900f8a0a68655d7c3f: done: 0.538768 sec","job_status":"done","queue_duration_s":0.73749,"scheduling_latency_s":0.737525,"redis_calls":12,"redis_duration_s":0.017692,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004386,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002797,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.153,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.148,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.329058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00159802,"exclusive_lock_hold_duration_s":0.47218267999999997,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.538768,"completed_at":"2026-08-16T17:59:21.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.204519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.770350] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c58afd71348d9b9cd3895b0c","created_at":"2026-08-16T17:59:20.329Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd5bbe887f2ebfb8585da24baa96452d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.343Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c58afd71348d9b9cd3895b0c: start","job_status":"start","queue_duration_s":1.200343,"scheduling_latency_s":1.200363} gitlab # [ 233.787595] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.557Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 233.792029] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c58afd71348d9b9cd3895b0c","created_at":"2026-08-16T17:59:20.329Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd5bbe887f2ebfb8585da24baa96452d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.343Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c58afd71348d9b9cd3895b0c: done: 0.020744 sec","job_status":"done","queue_duration_s":1.200343,"scheduling_latency_s":1.200363,"redis_calls":10,"redis_duration_s":0.002496,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000509,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053924,"duration_s":0.020744,"completed_at":"2026-08-16T17:59:21.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.835903] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ec8c4862295876059c94eb9d","created_at":"2026-08-16T17:59:20.354Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0aebe9b937cfecb93d882b0ddeed8fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:59:20.371Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ec8c4862295876059c94eb9d: start","job_status":"start","queue_duration_s":1.194509,"scheduling_latency_s":1.194526} gitlab # [ 233.849502] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.578Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 233.852795] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ec8c4862295876059c94eb9d","created_at":"2026-08-16T17:59:20.354Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0aebe9b937cfecb93d882b0ddeed8fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:59:20.371Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ec8c4862295876059c94eb9d: done: 0.019585 sec","job_status":"done","queue_duration_s":1.194509,"scheduling_latency_s":1.194526,"redis_calls":10,"redis_duration_s":0.002408,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033318,"duration_s":0.019585,"completed_at":"2026-08-16T17:59:21.586Z","load_balancing_strategy":"primary","db_duration_s":0.000432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.893729] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b35b42e894bc13e18e64fa6a","created_at":"2026-08-16T17:59:20.434Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4036e044b22288fb377c4348b201ec28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.446Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b35b42e894bc13e18e64fa6a: start","job_status":"start","queue_duration_s":1.140743,"scheduling_latency_s":1.140759} gitlab # [ 233.908170] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.599Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 233.911630] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b35b42e894bc13e18e64fa6a","created_at":"2026-08-16T17:59:20.434Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4036e044b22288fb377c4348b201ec28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.446Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b35b42e894bc13e18e64fa6a: done: 0.019862 sec","job_status":"done","queue_duration_s":1.140743,"scheduling_latency_s":1.140759,"redis_calls":10,"redis_duration_s":0.002395,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037572,"duration_s":0.019862,"completed_at":"2026-08-16T17:59:21.607Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.954006] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e7bd6497dcfc50e39b16496e","created_at":"2026-08-16T17:59:20.476Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84c129cc9ec55361a256346de8ed1c61","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.499Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e7bd6497dcfc50e39b16496e: start","job_status":"start","queue_duration_s":1.109438,"scheduling_latency_s":1.109455} gitlab # [ 234.064655] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e7bd6497dcfc50e39b16496e","created_at":"2026-08-16T17:59:20.476Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84c129cc9ec55361a256346de8ed1c61","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.499Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e7bd6497dcfc50e39b16496e: done: 0.321238 sec","job_status":"done","queue_duration_s":1.109438,"scheduling_latency_s":1.109455,"redis_calls":565,"redis_duration_s":0.073209,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.071604,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.282858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026022,"duration_s":0.321238,"completed_at":"2026-08-16T17:59:21.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.117986] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8d9d0f6e31eb03264b6fac5a","created_at":"2026-08-16T17:59:20.517Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49b99353af9e32f100402d3cb881fff3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.548Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8d9d0f6e31eb03264b6fac5a: start","job_status":"start","queue_duration_s":1.383381,"scheduling_latency_s":1.383399} gitlab # [ 234.132621] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8d9d0f6e31eb03264b6fac5a","created_at":"2026-08-16T17:59:20.517Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49b99353af9e32f100402d3cb881fff3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.548Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8d9d0f6e31eb03264b6fac5a: done: 0.031291 sec","job_status":"done","queue_duration_s":1.383381,"scheduling_latency_s":1.383399,"redis_calls":13,"redis_duration_s":0.001879,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.010073180000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.031291,"completed_at":"2026-08-16T17:59:21.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003003,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 234.176936] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c32d511a3e9015e2645ac41e","created_at":"2026-08-16T17:59:20.594Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c444eca7d44ac1ff7d3c56996c578a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:59:20.618Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c32d511a3e9015e2645ac41e: start","job_status":"start","queue_duration_s":1.34527,"scheduling_latency_s":1.345288} gitlab # [ 234.189912] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:21.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c32d511a3e9015e2645ac41e","created_at":"2026-08-16T17:59:20.594Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c444eca7d44ac1ff7d3c56996c578a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:59:20.618Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c32d511a3e9015e2645ac41e: done: 0.035031 sec","job_status":"done","queue_duration_s":1.34527,"scheduling_latency_s":1.345288,"redis_calls":10,"redis_duration_s":0.001874,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025476,"duration_s":0.035031,"completed_at":"2026-08-16T17:59:21.999Z","load_balancing_strategy":"primary","db_duration_s":0.004162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.232405] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.001Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c2361da81f836521e950f7ac","created_at":"2026-08-16T17:59:20.679Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"556cda042e6153c65ff76a543afc0344","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.699Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c2361da81f836521e950f7ac: start","job_status":"start","queue_duration_s":1.302509,"scheduling_latency_s":1.302527} gitlab # [ 234.246550] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c2361da81f836521e950f7ac","created_at":"2026-08-16T17:59:20.679Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"556cda042e6153c65ff76a543afc0344","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.699Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c2361da81f836521e950f7ac: done: 0.056781 sec","job_status":"done","queue_duration_s":1.302509,"scheduling_latency_s":1.302527,"redis_calls":16,"redis_duration_s":0.003894,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002006,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000677,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00087814,"duration_s":0.056781,"completed_at":"2026-08-16T17:59:22.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.288759] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ed3bed41069d669ec1e6f833","created_at":"2026-08-16T17:59:20.711Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.724Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ed3bed41069d669ec1e6f833: start","job_status":"start","queue_duration_s":1.337007,"scheduling_latency_s":1.337026} gitlab # [ 234.371476] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.236Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ed3bed41069d669ec1e6f833","created_at":"2026-08-16T17:59:20.711Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.724Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ed3bed41069d669ec1e6f833: done: 0.174798 sec","job_status":"done","queue_duration_s":1.337007,"scheduling_latency_s":1.337026,"redis_calls":71,"redis_duration_s":0.01668,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002598,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000875,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012199,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.153954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059286,"duration_s":0.174798,"completed_at":"2026-08-16T17:59:22.236Z","load_balancing_strategy":"primary","db_duration_s":0.002077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.445049] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"522207b91c85c4b33724aeb4","created_at":"2026-08-16T17:59:20.745Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.761Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-522207b91c85c4b33724aeb4: start","job_status":"start","queue_duration_s":1.478338,"scheduling_latency_s":1.478358} gitlab # [ 234.462843] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"522207b91c85c4b33724aeb4","created_at":"2026-08-16T17:59:20.745Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.761Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-522207b91c85c4b33724aeb4: done: 0.069679 sec","job_status":"done","queue_duration_s":1.478338,"scheduling_latency_s":1.478358,"redis_calls":19,"redis_duration_s":0.005346,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001049,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000242,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003317,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067316,"duration_s":0.069679,"completed_at":"2026-08-16T17:59:22.309Z","load_balancing_strategy":"primary","db_duration_s":0.003001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.508027] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ffa40d8b6f57d2d8c0a59ef6","created_at":"2026-08-16T17:59:20.817Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b718e0c76b89e566c82356600c99ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.834Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ffa40d8b6f57d2d8c0a59ef6: start","job_status":"start","queue_duration_s":1.477633,"scheduling_latency_s":1.477659} gitlab # [ 234.521545] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ffa40d8b6f57d2d8c0a59ef6","created_at":"2026-08-16T17:59:20.817Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63b718e0c76b89e566c82356600c99ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.834Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ffa40d8b6f57d2d8c0a59ef6: done: 0.035337 sec","job_status":"done","queue_duration_s":1.477633,"scheduling_latency_s":1.477659,"redis_calls":12,"redis_duration_s":0.002326,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055142,"exclusive_lock_hold_duration_s":0.00814764,"duration_s":0.035337,"completed_at":"2026-08-16T17:59:22.347Z","load_balancing_strategy":"primary","db_duration_s":0.003256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.562753] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5c308c8cb6406370d7aa58de","created_at":"2026-08-16T17:59:20.857Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09648fb416ad1c30eb100cac700f2b14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.932Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5c308c8cb6406370d7aa58de: start","job_status":"start","queue_duration_s":1.415989,"scheduling_latency_s":1.416066} gitlab # [ 234.577455] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5c308c8cb6406370d7aa58de","created_at":"2026-08-16T17:59:20.857Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09648fb416ad1c30eb100cac700f2b14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:20.932Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5c308c8cb6406370d7aa58de: done: 0.040236 sec","job_status":"done","queue_duration_s":1.415989,"scheduling_latency_s":1.416066,"redis_calls":12,"redis_duration_s":0.00288,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000857,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052866,"duration_s":0.040236,"completed_at":"2026-08-16T17:59:22.388Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.620072] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"88d53eec84b8289a17c2f151","created_at":"2026-08-16T17:59:20.967Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa342be0c024869ae6e8169928c60dd1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.009Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-88d53eec84b8289a17c2f151: start","job_status":"start","queue_duration_s":1.382677,"scheduling_latency_s":1.382701} gitlab # [ 234.763573] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"88d53eec84b8289a17c2f151","created_at":"2026-08-16T17:59:20.967Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa342be0c024869ae6e8169928c60dd1","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.009Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-88d53eec84b8289a17c2f151: done: 0.234693 sec","job_status":"done","queue_duration_s":1.382677,"scheduling_latency_s":1.382701,"redis_calls":10,"redis_duration_s":0.004874,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.188742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00183384,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.234693,"completed_at":"2026-08-16T17:59:22.626Z","load_balancing_strategy":"primary","db_duration_s":0.019762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.814545] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9991efbe1a1d1c244b347476","created_at":"2026-08-16T17:59:21.039Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71b4dd6276778829bb84851e0769a00c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:59:21.067Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9991efbe1a1d1c244b347476: start","job_status":"start","queue_duration_s":1.567069,"scheduling_latency_s":1.567142} gitlab # [ 234.845049] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.710Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 234.878248] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9991efbe1a1d1c244b347476","created_at":"2026-08-16T17:59:21.039Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71b4dd6276778829bb84851e0769a00c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:59:21.067Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9991efbe1a1d1c244b347476: done: 0.108731 sec","job_status":"done","queue_duration_s":1.567069,"scheduling_latency_s":1.567142,"redis_calls":10,"redis_duration_s":0.0065509999999999995,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00108,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001643,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00100228,"duration_s":0.108731,"completed_at":"2026-08-16T17:59:22.742Z","load_balancing_strategy":"primary","db_duration_s":0.001125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.931963] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9b83d92af5b124f70c6b734e","created_at":"2026-08-16T17:59:21.091Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c2409329f507bb3a4999c8f857cef8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.110Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9b83d92af5b124f70c6b734e: start","job_status":"start","queue_duration_s":1.636638,"scheduling_latency_s":1.636673} gitlab # [ 234.962353] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9b83d92af5b124f70c6b734e","created_at":"2026-08-16T17:59:21.091Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c2409329f507bb3a4999c8f857cef8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.110Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9b83d92af5b124f70c6b734e: done: 0.080181 sec","job_status":"done","queue_duration_s":1.636638,"scheduling_latency_s":1.636673,"redis_calls":10,"redis_duration_s":0.005937,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001069,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00129558,"duration_s":0.080181,"completed_at":"2026-08-16T17:59:22.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.010491] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"aa25709243264c7b4638bab6","created_at":"2026-08-16T17:59:21.131Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72bcd78fa669e984a8016b2e2e6bd0cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.149Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-aa25709243264c7b4638bab6: start","job_status":"start","queue_duration_s":1.683665,"scheduling_latency_s":1.683712} gitlab # [ 235.025170] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.877Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 235.033306] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"aa25709243264c7b4638bab6","created_at":"2026-08-16T17:59:21.131Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72bcd78fa669e984a8016b2e2e6bd0cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.149Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-aa25709243264c7b4638bab6: done: 0.065743 sec","job_status":"done","queue_duration_s":1.683665,"scheduling_latency_s":1.683712,"redis_calls":10,"redis_duration_s":0.005151,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000962,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00146144,"duration_s":0.065743,"completed_at":"2026-08-16T17:59:22.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.075639] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c24d7cfc3eb81ae4d358d4c","created_at":"2026-08-16T17:59:21.167Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e8f8990453bebdec13a63a1caacfad8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.194Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c24d7cfc3eb81ae4d358d4c: start","job_status":"start","queue_duration_s":1.70848,"scheduling_latency_s":1.708562} gitlab # [ 235.098815] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c24d7cfc3eb81ae4d358d4c","created_at":"2026-08-16T17:59:21.167Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e8f8990453bebdec13a63a1caacfad8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:59:21.194Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c24d7cfc3eb81ae4d358d4c: done: 0.060679 sec","job_status":"done","queue_duration_s":1.70848,"scheduling_latency_s":1.708562,"redis_calls":12,"redis_duration_s":0.005356,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000795,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00113326,"exclusive_lock_hold_duration_s":0.00951292,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.060679,"completed_at":"2026-08-16T17:59:22.963Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.142414] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:22.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b9f847cdaf2a22f56dfa3e2","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b9f847cdaf2a22f56dfa3e2: start","job_status":"start","queue_duration_s":0.747943,"scheduling_latency_s":0.747984} gitlab # [ 235.154793] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b9f847cdaf2a22f56dfa3e2","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b9f847cdaf2a22f56dfa3e2: done: 0.049608 sec","job_status":"done","queue_duration_s":0.747943,"scheduling_latency_s":0.747984,"redis_calls":16,"redis_duration_s":0.007292,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000914,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004389,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007295,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049608,"completed_at":"2026-08-16T17:59:23.017Z","load_balancing_strategy":"primary","db_duration_s":0.001113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.196076] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0171759023bf340e00ce9fe","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0171759023bf340e00ce9fe: start","job_status":"start","queue_duration_s":0.79979,"scheduling_latency_s":0.799821} gitlab # [ 235.208358] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0171759023bf340e00ce9fe","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0171759023bf340e00ce9fe: done: 0.029978 sec","job_status":"done","queue_duration_s":0.79979,"scheduling_latency_s":0.799821,"redis_calls":13,"redis_duration_s":0.004281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029978,"completed_at":"2026-08-16T17:59:23.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.248844] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc16fcdcce4df10e9ac405ea","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc16fcdcce4df10e9ac405ea: start","job_status":"start","queue_duration_s":0.831569,"scheduling_latency_s":0.831594} gitlab # [ 235.261020] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc16fcdcce4df10e9ac405ea","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc16fcdcce4df10e9ac405ea: done: 0.030016 sec","job_status":"done","queue_duration_s":0.831569,"scheduling_latency_s":0.831594,"redis_calls":13,"redis_duration_s":0.0036420000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002487,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030016,"completed_at":"2026-08-16T17:59:23.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.300790] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77476ce73615e8c514ab4b55","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77476ce73615e8c514ab4b55: start","job_status":"start","queue_duration_s":0.864637,"scheduling_latency_s":0.864663} gitlab # [ 235.312944] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77476ce73615e8c514ab4b55","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77476ce73615e8c514ab4b55: done: 0.030868 sec","job_status":"done","queue_duration_s":0.864637,"scheduling_latency_s":0.864663,"redis_calls":13,"redis_duration_s":0.004801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030868,"completed_at":"2026-08-16T17:59:23.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.352499] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ddae629c52283512af9b37f","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ddae629c52283512af9b37f: start","job_status":"start","queue_duration_s":0.898088,"scheduling_latency_s":0.898169} gitlab # [ 235.364793] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ddae629c52283512af9b37f","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ddae629c52283512af9b37f: done: 0.025752 sec","job_status":"done","queue_duration_s":0.898088,"scheduling_latency_s":0.898169,"redis_calls":13,"redis_duration_s":0.003354,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025752,"completed_at":"2026-08-16T17:59:23.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.403994] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e39897b767a1149cdec46a65","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e39897b767a1149cdec46a65: start","job_status":"start","queue_duration_s":0.926762,"scheduling_latency_s":0.926783} gitlab # [ 235.416296] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e39897b767a1149cdec46a65","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e39897b767a1149cdec46a65: done: 0.031346 sec","job_status":"done","queue_duration_s":0.926762,"scheduling_latency_s":0.926783,"redis_calls":13,"redis_duration_s":0.004664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031346,"completed_at":"2026-08-16T17:59:23.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.456760] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d9f5144eee520c849c60841","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d9f5144eee520c849c60841: start","job_status":"start","queue_duration_s":0.961067,"scheduling_latency_s":0.961148} gitlab # [ 235.468994] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d9f5144eee520c849c60841","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d9f5144eee520c849c60841: done: 0.028655 sec","job_status":"done","queue_duration_s":0.961067,"scheduling_latency_s":0.961148,"redis_calls":13,"redis_duration_s":0.004762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028655,"completed_at":"2026-08-16T17:59:23.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.508335] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4877a3e1becfe4b91643a216","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4877a3e1becfe4b91643a216: start","job_status":"start","queue_duration_s":0.99159,"scheduling_latency_s":0.991607} gitlab # [ 235.520466] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4877a3e1becfe4b91643a216","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4877a3e1becfe4b91643a216: done: 0.026646 sec","job_status":"done","queue_duration_s":0.99159,"scheduling_latency_s":0.991607,"redis_calls":13,"redis_duration_s":0.004311,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026646,"completed_at":"2026-08-16T17:59:23.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.559859] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f2e2a9bd448f13e72dac51b","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f2e2a9bd448f13e72dac51b: start","job_status":"start","queue_duration_s":1.020645,"scheduling_latency_s":1.020663} gitlab # [ 235.572426] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f2e2a9bd448f13e72dac51b","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f2e2a9bd448f13e72dac51b: done: 0.020963 sec","job_status":"done","queue_duration_s":1.020645,"scheduling_latency_s":1.020663,"redis_calls":13,"redis_duration_s":0.0034730000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020963,"completed_at":"2026-08-16T17:59:23.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.612165] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6df17e7ad33674b4f5fc5b8c","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6df17e7ad33674b4f5fc5b8c: start","job_status":"start","queue_duration_s":1.043724,"scheduling_latency_s":1.043742} gitlab # [ 235.624308] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6df17e7ad33674b4f5fc5b8c","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6df17e7ad33674b4f5fc5b8c: done: 0.025145 sec","job_status":"done","queue_duration_s":1.043724,"scheduling_latency_s":1.043742,"redis_calls":13,"redis_duration_s":0.003908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002526,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025145,"completed_at":"2026-08-16T17:59:23.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.664587] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f18f558d03d8999933e4590c","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f18f558d03d8999933e4590c: start","job_status":"start","queue_duration_s":1.072365,"scheduling_latency_s":1.072381} gitlab # [ 235.676762] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f18f558d03d8999933e4590c","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f18f558d03d8999933e4590c: done: 0.023667 sec","job_status":"done","queue_duration_s":1.072365,"scheduling_latency_s":1.072381,"redis_calls":13,"redis_duration_s":0.005033,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023667,"completed_at":"2026-08-16T17:59:23.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.716242] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b8bb5830dbbd048798bddf4","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b8bb5830dbbd048798bddf4: start","job_status":"start","queue_duration_s":1.099371,"scheduling_latency_s":1.099389} gitlab # [ 235.729108] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b8bb5830dbbd048798bddf4","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b8bb5830dbbd048798bddf4: done: 0.022357 sec","job_status":"done","queue_duration_s":1.099371,"scheduling_latency_s":1.099389,"redis_calls":13,"redis_duration_s":0.003593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002441,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022357,"completed_at":"2026-08-16T17:59:23.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.769533] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024ec818490e77bc5bbd89e2","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024ec818490e77bc5bbd89e2: start","job_status":"start","queue_duration_s":1.123946,"scheduling_latency_s":1.123964} gitlab # [ 235.782107] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024ec818490e77bc5bbd89e2","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024ec818490e77bc5bbd89e2: done: 0.020676 sec","job_status":"done","queue_duration_s":1.123946,"scheduling_latency_s":1.123964,"redis_calls":13,"redis_duration_s":0.003477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020676,"completed_at":"2026-08-16T17:59:23.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.821407] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d0a1daba4405c0b25551350","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d0a1daba4405c0b25551350: start","job_status":"start","queue_duration_s":1.146758,"scheduling_latency_s":1.146775} gitlab # [ 235.833938] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d0a1daba4405c0b25551350","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d0a1daba4405c0b25551350: done: 0.01932 sec","job_status":"done","queue_duration_s":1.146758,"scheduling_latency_s":1.146775,"redis_calls":13,"redis_duration_s":0.0033949999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01932,"completed_at":"2026-08-16T17:59:23.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.874698] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf057da9d2d3d7b9c9fe428","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf057da9d2d3d7b9c9fe428: start","job_status":"start","queue_duration_s":1.169287,"scheduling_latency_s":1.169305} gitlab # [ 235.887412] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf057da9d2d3d7b9c9fe428","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf057da9d2d3d7b9c9fe428: done: 0.027955 sec","job_status":"done","queue_duration_s":1.169287,"scheduling_latency_s":1.169305,"redis_calls":13,"redis_duration_s":0.005526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003677,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027955,"completed_at":"2026-08-16T17:59:23.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.926830] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471ed6de70373429b16f2941","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471ed6de70373429b16f2941: start","job_status":"start","queue_duration_s":1.199865,"scheduling_latency_s":1.199882} gitlab # [ 235.939914] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471ed6de70373429b16f2941","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471ed6de70373429b16f2941: done: 0.030993 sec","job_status":"done","queue_duration_s":1.199865,"scheduling_latency_s":1.199882,"redis_calls":13,"redis_duration_s":0.005041,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003412,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030993,"completed_at":"2026-08-16T17:59:23.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.979865] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01d420e44a41b119c3ce9af","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01d420e44a41b119c3ce9af: start","job_status":"start","queue_duration_s":1.233445,"scheduling_latency_s":1.233462} gitlab # [ 235.992684] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01d420e44a41b119c3ce9af","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01d420e44a41b119c3ce9af: done: 0.035438 sec","job_status":"done","queue_duration_s":1.233445,"scheduling_latency_s":1.233462,"redis_calls":13,"redis_duration_s":0.005263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035438,"completed_at":"2026-08-16T17:59:23.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.032315] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c8aca74c42db8059aa945ed","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c8aca74c42db8059aa945ed: start","job_status":"start","queue_duration_s":1.271476,"scheduling_latency_s":1.271492} gitlab # [ 236.044708] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c8aca74c42db8059aa945ed","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c8aca74c42db8059aa945ed: done: 0.033632 sec","job_status":"done","queue_duration_s":1.271476,"scheduling_latency_s":1.271492,"redis_calls":13,"redis_duration_s":0.005163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033632,"completed_at":"2026-08-16T17:59:23.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.085331] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ad6400aaf2a2076c121b815","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ad6400aaf2a2076c121b815: start","job_status":"start","queue_duration_s":1.310649,"scheduling_latency_s":1.310667} gitlab # [ 236.097928] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ad6400aaf2a2076c121b815","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ad6400aaf2a2076c121b815: done: 0.030301 sec","job_status":"done","queue_duration_s":1.310649,"scheduling_latency_s":1.310667,"redis_calls":13,"redis_duration_s":0.003585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030301,"completed_at":"2026-08-16T17:59:23.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.137302] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82ae9f0debfe68ce6ba151c1","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82ae9f0debfe68ce6ba151c1: start","job_status":"start","queue_duration_s":1.343798,"scheduling_latency_s":1.343875} gitlab # [ 236.150072] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82ae9f0debfe68ce6ba151c1","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82ae9f0debfe68ce6ba151c1: done: 0.030204 sec","job_status":"done","queue_duration_s":1.343798,"scheduling_latency_s":1.343875,"redis_calls":13,"redis_duration_s":0.002345,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030204,"completed_at":"2026-08-16T17:59:23.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.189403] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"697297175fc435d56becf354","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-697297175fc435d56becf354: start","job_status":"start","queue_duration_s":1.376205,"scheduling_latency_s":1.376238} gitlab # [ 236.202030] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"697297175fc435d56becf354","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-697297175fc435d56becf354: done: 0.032912 sec","job_status":"done","queue_duration_s":1.376205,"scheduling_latency_s":1.376238,"redis_calls":13,"redis_duration_s":0.003139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032912,"completed_at":"2026-08-16T17:59:23.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.241389] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5377357c1d2da84b39a29c","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5377357c1d2da84b39a29c: start","job_status":"start","queue_duration_s":1.41158,"scheduling_latency_s":1.411661} gitlab # [ 236.254996] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5377357c1d2da84b39a29c","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5377357c1d2da84b39a29c: done: 0.035304 sec","job_status":"done","queue_duration_s":1.41158,"scheduling_latency_s":1.411661,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035304,"completed_at":"2026-08-16T17:59:23.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.294595] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a815dedcfccecc696d6659","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a815dedcfccecc696d6659: start","job_status":"start","queue_duration_s":1.449671,"scheduling_latency_s":1.449689} gitlab # [ 236.306988] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a815dedcfccecc696d6659","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a815dedcfccecc696d6659: done: 0.034898 sec","job_status":"done","queue_duration_s":1.449671,"scheduling_latency_s":1.449689,"redis_calls":13,"redis_duration_s":0.003159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002293,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034898,"completed_at":"2026-08-16T17:59:23.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.346683] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8309d9423e6e15903eab4fa","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8309d9423e6e15903eab4fa: start","job_status":"start","queue_duration_s":1.487647,"scheduling_latency_s":1.487718} gitlab # [ 236.359213] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8309d9423e6e15903eab4fa","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8309d9423e6e15903eab4fa: done: 0.034238 sec","job_status":"done","queue_duration_s":1.487647,"scheduling_latency_s":1.487718,"redis_calls":13,"redis_duration_s":0.003536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034238,"completed_at":"2026-08-16T17:59:23.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.398494] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7917a15c9798c9006d618bff","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7917a15c9798c9006d618bff: start","job_status":"start","queue_duration_s":1.524132,"scheduling_latency_s":1.5242} gitlab # [ 236.410868] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7917a15c9798c9006d618bff","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7917a15c9798c9006d618bff: done: 0.032718 sec","job_status":"done","queue_duration_s":1.524132,"scheduling_latency_s":1.5242,"redis_calls":13,"redis_duration_s":0.00317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032718,"completed_at":"2026-08-16T17:59:23.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.450082] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02f9891ef6179ef71a9d88bb","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02f9891ef6179ef71a9d88bb: start","job_status":"start","queue_duration_s":1.559014,"scheduling_latency_s":1.559034} gitlab # [ 236.463712] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02f9891ef6179ef71a9d88bb","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02f9891ef6179ef71a9d88bb: done: 0.031559 sec","job_status":"done","queue_duration_s":1.559014,"scheduling_latency_s":1.559034,"redis_calls":13,"redis_duration_s":0.003029,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031559,"completed_at":"2026-08-16T17:59:23.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.503214] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"078822709ec1d1bb68c10ca3","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-078822709ec1d1bb68c10ca3: start","job_status":"start","queue_duration_s":1.592894,"scheduling_latency_s":1.592911} gitlab # [ 236.515901] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"078822709ec1d1bb68c10ca3","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-078822709ec1d1bb68c10ca3: done: 0.033421 sec","job_status":"done","queue_duration_s":1.592894,"scheduling_latency_s":1.592911,"redis_calls":13,"redis_duration_s":0.003286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033421,"completed_at":"2026-08-16T17:59:23.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.555459] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"227f65d6bee808948b0461ca","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-227f65d6bee808948b0461ca: start","job_status":"start","queue_duration_s":1.629226,"scheduling_latency_s":1.629246} gitlab # [ 236.567824] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"227f65d6bee808948b0461ca","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-227f65d6bee808948b0461ca: done: 0.03288 sec","job_status":"done","queue_duration_s":1.629226,"scheduling_latency_s":1.629246,"redis_calls":13,"redis_duration_s":0.0028450000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001779,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03288,"completed_at":"2026-08-16T17:59:23.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.607467] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8f9261c28725ef776b87ec5","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8f9261c28725ef776b87ec5: start","job_status":"start","queue_duration_s":1.664439,"scheduling_latency_s":1.664521} gitlab # [ 236.619978] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8f9261c28725ef776b87ec5","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8f9261c28725ef776b87ec5: done: 0.035973 sec","job_status":"done","queue_duration_s":1.664439,"scheduling_latency_s":1.664521,"redis_calls":13,"redis_duration_s":0.004313,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002636,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035973,"completed_at":"2026-08-16T17:59:23.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.659186] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:23.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3d7faf9f369f8c75779aec2","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3d7faf9f369f8c75779aec2: start","job_status":"start","queue_duration_s":1.702323,"scheduling_latency_s":1.70234} gitlab # [ 236.672678] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3d7faf9f369f8c75779aec2","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3d7faf9f369f8c75779aec2: done: 0.480744 sec","job_status":"done","queue_duration_s":1.702323,"scheduling_latency_s":1.70234,"redis_calls":13,"redis_duration_s":0.106397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.10434,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.480744,"completed_at":"2026-08-16T17:59:24.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.712125] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54ffedaff0c05abcd9e3a10a","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54ffedaff0c05abcd9e3a10a: start","job_status":"start","queue_duration_s":2.191032,"scheduling_latency_s":2.191084} gitlab # [ 236.724648] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54ffedaff0c05abcd9e3a10a","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54ffedaff0c05abcd9e3a10a: done: 0.065002 sec","job_status":"done","queue_duration_s":2.191032,"scheduling_latency_s":2.191084,"redis_calls":13,"redis_duration_s":0.005657000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002366,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003291,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.065002,"completed_at":"2026-08-16T17:59:24.475Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.764258] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3dc4981fe9db304b52b38d8","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3dc4981fe9db304b52b38d8: start","job_status":"start","queue_duration_s":2.25883,"scheduling_latency_s":2.258936} gitlab # [ 236.777487] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3dc4981fe9db304b52b38d8","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3dc4981fe9db304b52b38d8: done: 0.038233 sec","job_status":"done","queue_duration_s":2.25883,"scheduling_latency_s":2.258936,"redis_calls":13,"redis_duration_s":0.003833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038233,"completed_at":"2026-08-16T17:59:24.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.817033] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d427444eee5f3f6984fde55","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d427444eee5f3f6984fde55: start","job_status":"start","queue_duration_s":2.299496,"scheduling_latency_s":2.29952} gitlab # [ 236.829644] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d427444eee5f3f6984fde55","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d427444eee5f3f6984fde55: done: 0.025288 sec","job_status":"done","queue_duration_s":2.299496,"scheduling_latency_s":2.29952,"redis_calls":13,"redis_duration_s":0.002308,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001503,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025288,"completed_at":"2026-08-16T17:59:24.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.870660] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09517f2a1a55776635755a8f","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09517f2a1a55776635755a8f: start","job_status":"start","queue_duration_s":2.327315,"scheduling_latency_s":2.327336} gitlab # [ 236.883164] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09517f2a1a55776635755a8f","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09517f2a1a55776635755a8f: done: 0.029304 sec","job_status":"done","queue_duration_s":2.327315,"scheduling_latency_s":2.327336,"redis_calls":13,"redis_duration_s":0.002173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001584,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029304,"completed_at":"2026-08-16T17:59:24.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.922860] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baf7d30adf05c2029e65647b","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baf7d30adf05c2029e65647b: start","job_status":"start","queue_duration_s":2.358819,"scheduling_latency_s":2.358842} gitlab # [ 236.936156] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baf7d30adf05c2029e65647b","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baf7d30adf05c2029e65647b: done: 0.024013 sec","job_status":"done","queue_duration_s":2.358819,"scheduling_latency_s":2.358842,"redis_calls":13,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024013,"completed_at":"2026-08-16T17:59:24.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.976049] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d72c417470a2e3069121ac2a","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d72c417470a2e3069121ac2a: start","job_status":"start","queue_duration_s":2.384861,"scheduling_latency_s":2.384881} gitlab # [ 236.988609] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d72c417470a2e3069121ac2a","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d72c417470a2e3069121ac2a: done: 0.029018 sec","job_status":"done","queue_duration_s":2.384861,"scheduling_latency_s":2.384881,"redis_calls":13,"redis_duration_s":0.0029240000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029018,"completed_at":"2026-08-16T17:59:24.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.028388] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5feca92b3811d494a5baab9a","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5feca92b3811d494a5baab9a: start","job_status":"start","queue_duration_s":2.415925,"scheduling_latency_s":2.415947} gitlab # [ 237.041058] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5feca92b3811d494a5baab9a","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5feca92b3811d494a5baab9a: done: 0.028808 sec","job_status":"done","queue_duration_s":2.415925,"scheduling_latency_s":2.415947,"redis_calls":13,"redis_duration_s":0.003071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028808,"completed_at":"2026-08-16T17:59:24.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.081860] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9790662a6db37442633ac595","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9790662a6db37442633ac595: start","job_status":"start","queue_duration_s":2.446249,"scheduling_latency_s":2.44627} gitlab # [ 237.094406] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9790662a6db37442633ac595","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9790662a6db37442633ac595: done: 0.02966 sec","job_status":"done","queue_duration_s":2.446249,"scheduling_latency_s":2.44627,"redis_calls":13,"redis_duration_s":0.0023309999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001607,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02966,"completed_at":"2026-08-16T17:59:24.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.134220] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15aec9a61e612a31a042dedb","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15aec9a61e612a31a042dedb: start","job_status":"start","queue_duration_s":2.477562,"scheduling_latency_s":2.477646} gitlab # [ 237.147031] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15aec9a61e612a31a042dedb","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15aec9a61e612a31a042dedb: done: 0.031226 sec","job_status":"done","queue_duration_s":2.477562,"scheduling_latency_s":2.477646,"redis_calls":13,"redis_duration_s":0.002792,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031226,"completed_at":"2026-08-16T17:59:24.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.186489] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0956a6918a97c2b97c017ed","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0956a6918a97c2b97c017ed: start","job_status":"start","queue_duration_s":2.510136,"scheduling_latency_s":2.510162} gitlab # [ 237.198824] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0956a6918a97c2b97c017ed","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0956a6918a97c2b97c017ed: done: 0.029038 sec","job_status":"done","queue_duration_s":2.510136,"scheduling_latency_s":2.510162,"redis_calls":13,"redis_duration_s":0.002849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029038,"completed_at":"2026-08-16T17:59:24.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.238270] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dabcf462d6972fe0768328b8","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dabcf462d6972fe0768328b8: start","job_status":"start","queue_duration_s":2.540753,"scheduling_latency_s":2.540774} gitlab # [ 237.250794] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dabcf462d6972fe0768328b8","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dabcf462d6972fe0768328b8: done: 0.021999 sec","job_status":"done","queue_duration_s":2.540753,"scheduling_latency_s":2.540774,"redis_calls":13,"redis_duration_s":0.002673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001679,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021999,"completed_at":"2026-08-16T17:59:24.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.291238] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed370d24709aa855a345978","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed370d24709aa855a345978: start","job_status":"start","queue_duration_s":2.56491,"scheduling_latency_s":2.564995} gitlab # [ 237.303617] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed370d24709aa855a345978","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed370d24709aa855a345978: done: 0.025194 sec","job_status":"done","queue_duration_s":2.56491,"scheduling_latency_s":2.564995,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025194,"completed_at":"2026-08-16T17:59:24.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.343082] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c391578c16d73e4714d9272d","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c391578c16d73e4714d9272d: start","job_status":"start","queue_duration_s":2.592306,"scheduling_latency_s":2.592327} gitlab # [ 237.356200] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c391578c16d73e4714d9272d","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c391578c16d73e4714d9272d: done: 0.024563 sec","job_status":"done","queue_duration_s":2.592306,"scheduling_latency_s":2.592327,"redis_calls":13,"redis_duration_s":0.002387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001504,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024563,"completed_at":"2026-08-16T17:59:24.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.395300] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c11d3727d96eddf799fac46d","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c11d3727d96eddf799fac46d: start","job_status":"start","queue_duration_s":2.61923,"scheduling_latency_s":2.619253} gitlab # [ 237.407797] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c11d3727d96eddf799fac46d","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c11d3727d96eddf799fac46d: done: 0.028532 sec","job_status":"done","queue_duration_s":2.61923,"scheduling_latency_s":2.619253,"redis_calls":13,"redis_duration_s":0.003157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028532,"completed_at":"2026-08-16T17:59:24.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.447377] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07bae097a4e0581fb1c17dd5","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07bae097a4e0581fb1c17dd5: start","job_status":"start","queue_duration_s":2.649177,"scheduling_latency_s":2.6492} gitlab # [ 237.459861] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07bae097a4e0581fb1c17dd5","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07bae097a4e0581fb1c17dd5: done: 0.02879 sec","job_status":"done","queue_duration_s":2.649177,"scheduling_latency_s":2.6492,"redis_calls":13,"redis_duration_s":0.002588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001782,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02879,"completed_at":"2026-08-16T17:59:24.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.500972] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe4b3210f04ff4c950d5b07","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe4b3210f04ff4c950d5b07: start","job_status":"start","queue_duration_s":2.679325,"scheduling_latency_s":2.679345} gitlab # [ 237.513394] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe4b3210f04ff4c950d5b07","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe4b3210f04ff4c950d5b07: done: 0.021828 sec","job_status":"done","queue_duration_s":2.679325,"scheduling_latency_s":2.679345,"redis_calls":13,"redis_duration_s":0.002149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021828,"completed_at":"2026-08-16T17:59:24.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.552663] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e7a7f6262c4e880b0267399","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e7a7f6262c4e880b0267399: start","job_status":"start","queue_duration_s":2.702339,"scheduling_latency_s":2.702359} gitlab # [ 237.564698] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e7a7f6262c4e880b0267399","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e7a7f6262c4e880b0267399: done: 0.014415 sec","job_status":"done","queue_duration_s":2.702339,"scheduling_latency_s":2.702359,"redis_calls":13,"redis_duration_s":0.001504,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014415,"completed_at":"2026-08-16T17:59:24.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.603860] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2010961aa24340121dc9002d","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2010961aa24340121dc9002d: start","job_status":"start","queue_duration_s":2.717894,"scheduling_latency_s":2.717914} gitlab # [ 237.616430] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2010961aa24340121dc9002d","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2010961aa24340121dc9002d: done: 0.014258 sec","job_status":"done","queue_duration_s":2.717894,"scheduling_latency_s":2.717914,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014258,"completed_at":"2026-08-16T17:59:24.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.655063] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"616640a6740fe1e5271bd6bf","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-616640a6740fe1e5271bd6bf: start","job_status":"start","queue_duration_s":2.733291,"scheduling_latency_s":2.733308} gitlab # [ 237.667685] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"616640a6740fe1e5271bd6bf","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-616640a6740fe1e5271bd6bf: done: 0.014116 sec","job_status":"done","queue_duration_s":2.733291,"scheduling_latency_s":2.733308,"redis_calls":13,"redis_duration_s":0.001502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014116,"completed_at":"2026-08-16T17:59:24.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.707875] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33b61ec44f86288d10fc2780","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33b61ec44f86288d10fc2780: start","job_status":"start","queue_duration_s":2.748578,"scheduling_latency_s":2.748595} gitlab # [ 237.720407] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33b61ec44f86288d10fc2780","created_at":"2026-08-16T17:59:22.096Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-ca7b46712a834ada","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c00b00fa96931adad9d0d61cf63e08f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.219Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33b61ec44f86288d10fc2780: done: 0.014188 sec","job_status":"done","queue_duration_s":2.748578,"scheduling_latency_s":2.748595,"redis_calls":13,"redis_duration_s":0.0015469999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014188,"completed_at":"2026-08-16T17:59:24.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.759667] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:24.983Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c55d8ebdf1dce3fb71e32c8c","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c55d8ebdf1dce3fb71e32c8c: start","job_status":"start","queue_duration_s":2.690224,"scheduling_latency_s":2.690241} gitlab # [ 237.772089] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.002Z","message":"No existing merge request to be cleaned up."} gitlab # [ 237.773732] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.018Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c55d8ebdf1dce3fb71e32c8c","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c55d8ebdf1dce3fb71e32c8c: done: 0.034255 sec","job_status":"done","queue_duration_s":2.690224,"scheduling_latency_s":2.690241,"redis_calls":13,"redis_duration_s":0.00175,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027262,"duration_s":0.034255,"completed_at":"2026-08-16T17:59:25.018Z","load_balancing_strategy":"primary","db_duration_s":0.007941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.814012] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.019Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dbbbbc6ec6327f72905b8c17","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dbbbbc6ec6327f72905b8c17: start","job_status":"start","queue_duration_s":2.725687,"scheduling_latency_s":2.725704} gitlab # [ 237.826267] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.030Z","message":"No existing merge request to be cleaned up."} gitlab # [ 237.827902] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.038Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dbbbbc6ec6327f72905b8c17","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dbbbbc6ec6327f72905b8c17: done: 0.019129 sec","job_status":"done","queue_duration_s":2.725687,"scheduling_latency_s":2.725704,"redis_calls":10,"redis_duration_s":0.00141,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019129,"completed_at":"2026-08-16T17:59:25.038Z","load_balancing_strategy":"primary","db_duration_s":0.002692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.866976] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.039Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"671a3b0f31515362156cda83","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-671a3b0f31515362156cda83: start","job_status":"start","queue_duration_s":2.745991,"scheduling_latency_s":2.746007} gitlab # [ 237.879526] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.050Z","message":"No existing merge request to be cleaned up."} gitlab # [ 237.881327] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.058Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"671a3b0f31515362156cda83","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-671a3b0f31515362156cda83: done: 0.018416 sec","job_status":"done","queue_duration_s":2.745991,"scheduling_latency_s":2.746007,"redis_calls":10,"redis_duration_s":0.001405,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018416,"completed_at":"2026-08-16T17:59:25.057Z","load_balancing_strategy":"primary","db_duration_s":0.00237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.920721] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.059Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c332ccdc0e3e4aebfe572f51","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c332ccdc0e3e4aebfe572f51: start","job_status":"start","queue_duration_s":2.765552,"scheduling_latency_s":2.765568} gitlab # [ 237.932756] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.069Z","message":"No existing merge request to be cleaned up."} gitlab # [ 237.934496] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T17:59:25.077Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c332ccdc0e3e4aebfe572f51","created_at":"2026-08-16T17:59:22.270Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-9a20d91cb0964aea","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cb0feb7a56f59d65d71532d8b6f6d2fa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:59:22.293Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c332ccdc0e3e4aebfe572f51: done: 0.018741 sec","job_status":"done","queue_duration_s":2.765552,"scheduling_latency_s":2.765568,"redis_calls":10,"redis_duration_s":0.001366,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018741,"completed_at":"2026-08-16T17:59:25.077Z","load_balancing_strategy":"primary","db_duration_s":0.002567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.502432] setup-gitlab-start[2925]: W, [2026-08-16T17:59:54.367307 #2925] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 272.236934] systemd[1]: Starting Logrotate Service... gitlab # [ 272.393902] systemd[1]: logrotate.service: Deactivated successfully. gitlab # [ 272.396639] systemd[1]: Finished Logrotate Service. gitlab # [ 273.223614] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.087Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"c1211fcdb44f7047a441cf97","created_at":"2026-08-16T18:00:01.055Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de3f1990f115720d9f3a16b2c8ea5d78","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.082Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-c1211fcdb44f7047a441cf97: start","job_status":"start","queue_duration_s":0.005125,"scheduling_latency_s":0.005185} gitlab # [ 273.525781] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"c1211fcdb44f7047a441cf97","created_at":"2026-08-16T18:00:01.055Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de3f1990f115720d9f3a16b2c8ea5d78","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.082Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-c1211fcdb44f7047a441cf97: done: 0.302872 sec","job_status":"done","queue_duration_s":0.005125,"scheduling_latency_s":0.005185,"redis_calls":23,"redis_duration_s":0.02189,"redis_read_bytes":276,"redis_write_bytes":4771,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.006351,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1493,"redis_queues_calls":3,"redis_queues_duration_s":0.001857,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":502,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00342,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":461,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.058,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16100586,"duration_s":0.302872,"completed_at":"2026-08-16T18:00:01.390Z","load_balancing_strategy":"primary","db_duration_s":0.121041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.613922] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"1e886c3ee90e9b36f77a680a","created_at":"2026-08-16T18:00:01.144Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57992b18228748f62a316f04f18fd0b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.220Z","job_size_bytes":101,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-1e886c3ee90e9b36f77a680a: start","job_status":"start","queue_duration_s":0.183221,"scheduling_latency_s":0.18329} gitlab # [ 273.812196] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"1e886c3ee90e9b36f77a680a","created_at":"2026-08-16T18:00:01.144Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57992b18228748f62a316f04f18fd0b9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.220Z","job_size_bytes":101,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-1e886c3ee90e9b36f77a680a: done: 0.273476 sec","job_status":"done","queue_duration_s":0.183221,"scheduling_latency_s":0.18329,"redis_calls":11,"redis_duration_s":0.029704,"redis_read_bytes":13,"redis_write_bytes":1203,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.004972,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.020715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004017,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00291818,"duration_s":0.273476,"completed_at":"2026-08-16T18:00:01.676Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.903160] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a8518f03e62acb3b173e3cfc","created_at":"2026-08-16T18:00:01.231Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31da0d80c0bbf167dd91959649fcfc66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.237Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a8518f03e62acb3b173e3cfc: start","job_status":"start","queue_duration_s":0.467071,"scheduling_latency_s":0.467119} gitlab # [ 274.081460] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a8518f03e62acb3b173e3cfc","created_at":"2026-08-16T18:00:01.231Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31da0d80c0bbf167dd91959649fcfc66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.237Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a8518f03e62acb3b173e3cfc: done: 0.239526 sec","job_status":"done","queue_duration_s":0.467071,"scheduling_latency_s":0.467119,"redis_calls":9,"redis_duration_s":0.032927,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.024993,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.043,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.02180578,"exclusive_lock_hold_duration_s":0.08008206,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.239526,"completed_at":"2026-08-16T18:00:01.943Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.174346] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:01.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"450dda9f1272b55c50d619b3","created_at":"2026-08-16T18:00:01.263Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8aa266afde8a1ebda671a617b9f00f32","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.275Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-450dda9f1272b55c50d619b3: start","job_status":"start","queue_duration_s":0.687744,"scheduling_latency_s":0.687796} gitlab # [ 274.233028] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"450dda9f1272b55c50d619b3","created_at":"2026-08-16T18:00:01.263Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8aa266afde8a1ebda671a617b9f00f32","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.275Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-450dda9f1272b55c50d619b3: done: 0.1335 sec","job_status":"done","queue_duration_s":0.687744,"scheduling_latency_s":0.687796,"redis_calls":13,"redis_duration_s":0.028873,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004774,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.013554,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0042439,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.1335,"completed_at":"2026-08-16T18:00:02.096Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.314017] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"bcf6d9f211f7d1a92c9dbea5","created_at":"2026-08-16T18:00:01.294Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68254d7032939b58c4dc66eabccf5962","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.304Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-bcf6d9f211f7d1a92c9dbea5: start","job_status":"start","queue_duration_s":0.806382,"scheduling_latency_s":0.806434} gitlab # [ 274.471880] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"bcf6d9f211f7d1a92c9dbea5","created_at":"2026-08-16T18:00:01.294Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68254d7032939b58c4dc66eabccf5962","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.304Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-bcf6d9f211f7d1a92c9dbea5: done: 0.226492 sec","job_status":"done","queue_duration_s":0.806382,"scheduling_latency_s":0.806434,"redis_calls":9,"redis_duration_s":0.016854,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005309,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.076,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00297706,"exclusive_lock_hold_duration_s":0.0515277,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.226492,"completed_at":"2026-08-16T18:00:02.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.081289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.559617] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"91336095839d711ac029eb85","created_at":"2026-08-16T18:00:01.354Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e85e37da41655fd0f210abb424216e8d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.368Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-91336095839d711ac029eb85: start","job_status":"start","queue_duration_s":0.984459,"scheduling_latency_s":0.984506} gitlab # [ 274.576863] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.379Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 274.580635] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"91336095839d711ac029eb85","created_at":"2026-08-16T18:00:01.354Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e85e37da41655fd0f210abb424216e8d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.368Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-91336095839d711ac029eb85: done: 0.051582 sec","job_status":"done","queue_duration_s":0.984459,"scheduling_latency_s":0.984506,"redis_calls":7,"redis_duration_s":0.003981999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001771,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051582,"completed_at":"2026-08-16T18:00:02.403Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.624913] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ae62cf63340161f672976333","created_at":"2026-08-16T18:00:01.387Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17138d217365f6a8312179eb9795d78c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.398Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ae62cf63340161f672976333: start","job_status":"start","queue_duration_s":1.049311,"scheduling_latency_s":1.049362} gitlab # [ 274.659011] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ae62cf63340161f672976333","created_at":"2026-08-16T18:00:01.387Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17138d217365f6a8312179eb9795d78c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.398Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ae62cf63340161f672976333: done: 0.076911 sec","job_status":"done","queue_duration_s":1.049311,"scheduling_latency_s":1.049362,"redis_calls":7,"redis_duration_s":0.005301,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000711,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076911,"completed_at":"2026-08-16T18:00:02.524Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.705626] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a51ff52311a42836e4d95205","created_at":"2026-08-16T18:00:01.420Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34e49dd064ec450efa850b313c9a48d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.461Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a51ff52311a42836e4d95205: start","job_status":"start","queue_duration_s":1.068724,"scheduling_latency_s":1.068764} gitlab # [ 274.774686] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a51ff52311a42836e4d95205","created_at":"2026-08-16T18:00:01.420Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34e49dd064ec450efa850b313c9a48d3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.461Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a51ff52311a42836e4d95205: done: 0.108496 sec","job_status":"done","queue_duration_s":1.068724,"scheduling_latency_s":1.068764,"redis_calls":12,"redis_duration_s":0.034415,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008775,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.018473,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0013502,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.108496,"completed_at":"2026-08-16T18:00:02.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 274.838336] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PruneOldEventsWorker","jid":"0a766f01547317e89798f850","created_at":"2026-08-16T18:00:01.492Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0060e4e62e74acb78aafb8a0dc852556","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa7847a0e96d8dccea25d7c51fc9fba0c73a3fc691400b9310229c28e3c4fab3","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.513Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"PruneOldEventsWorker JID-0a766f01547317e89798f850: start","job_status":"start","queue_duration_s":1.129926,"scheduling_latency_s":1.129968} gitlab # [ 274.946808] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PruneOldEventsWorker","jid":"0a766f01547317e89798f850","created_at":"2026-08-16T18:00:01.492Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0060e4e62e74acb78aafb8a0dc852556","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa7847a0e96d8dccea25d7c51fc9fba0c73a3fc691400b9310229c28e3c4fab3","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.513Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"PruneOldEventsWorker JID-0a766f01547317e89798f850: done: 0.168769 sec","job_status":"done","queue_duration_s":1.129926,"scheduling_latency_s":1.129968,"redis_calls":10,"redis_duration_s":0.036738,"redis_read_bytes":9,"redis_write_bytes":987,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001981,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.029656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005101,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00285742,"duration_s":0.168769,"completed_at":"2026-08-16T18:00:02.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.027946] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.817Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d9e3a1f876401ceb9a1b7809","created_at":"2026-08-16T18:00:01.523Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df04d11e20b52d310d9b3a09fd8a0f74","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.612Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d9e3a1f876401ceb9a1b7809: start","job_status":"start","queue_duration_s":1.205223,"scheduling_latency_s":1.205269} gitlab # [ 275.073727] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.938Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d9e3a1f876401ceb9a1b7809","created_at":"2026-08-16T18:00:01.523Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df04d11e20b52d310d9b3a09fd8a0f74","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.612Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d9e3a1f876401ceb9a1b7809: done: 0.120915 sec","job_status":"done","queue_duration_s":1.205223,"scheduling_latency_s":1.205269,"redis_calls":12,"redis_duration_s":0.008729,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.003248,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000703,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071242,"duration_s":0.120915,"completed_at":"2026-08-16T18:00:02.938Z","load_balancing_strategy":"primary","db_duration_s":0.04382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.147052] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:02.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"3f74fcabff5b8dbbfd1dc41a","created_at":"2026-08-16T18:00:01.627Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee453dfbb83fa6e268290cfaa0c6504a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.650Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-3f74fcabff5b8dbbfd1dc41a: start","job_status":"start","queue_duration_s":1.294252,"scheduling_latency_s":1.294299} gitlab # [ 275.196304] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"3f74fcabff5b8dbbfd1dc41a","created_at":"2026-08-16T18:00:01.627Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee453dfbb83fa6e268290cfaa0c6504a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.650Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-3f74fcabff5b8dbbfd1dc41a: done: 0.117133 sec","job_status":"done","queue_duration_s":1.294252,"scheduling_latency_s":1.294299,"redis_calls":20,"redis_duration_s":0.007366999999999999,"redis_read_bytes":23,"redis_write_bytes":4315,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002322,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.001022,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2020,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.003322,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056978,"duration_s":0.117133,"completed_at":"2026-08-16T18:00:03.061Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.282964] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bd8a214173a876e4d60ed51a","created_at":"2026-08-16T18:00:01.679Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95a52c86e952605d7983b032b66c4252","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.687Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bd8a214173a876e4d60ed51a: start","job_status":"start","queue_duration_s":1.377019,"scheduling_latency_s":1.377052} gitlab # [ 275.484390] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bd8a214173a876e4d60ed51a","created_at":"2026-08-16T18:00:01.679Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95a52c86e952605d7983b032b66c4252","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.687Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bd8a214173a876e4d60ed51a: done: 0.28601 sec","job_status":"done","queue_duration_s":1.377019,"scheduling_latency_s":1.377052,"redis_calls":11,"redis_duration_s":0.002792,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.219866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007868,"exclusive_lock_hold_duration_s":0.25725584,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.28601,"completed_at":"2026-08-16T18:00:03.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.075948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.582632] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"2f0ccbddbc8ee38ed34e1916","created_at":"2026-08-16T18:00:01.702Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12d75eafd91f179018b2bb9dc18c25f7","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.720Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-2f0ccbddbc8ee38ed34e1916: start","job_status":"start","queue_duration_s":1.631428,"scheduling_latency_s":1.631448} gitlab # [ 275.600650] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"2f0ccbddbc8ee38ed34e1916","created_at":"2026-08-16T18:00:01.702Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12d75eafd91f179018b2bb9dc18c25f7","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.720Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-2f0ccbddbc8ee38ed34e1916: done: 0.022551 sec","job_status":"done","queue_duration_s":1.631428,"scheduling_latency_s":1.631448,"redis_calls":10,"redis_duration_s":0.001683,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000364,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029064,"duration_s":0.022551,"completed_at":"2026-08-16T18:00:03.373Z","load_balancing_strategy":"primary","db_duration_s":0.000573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.654911] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"72aaf1573c69224c9e905070","created_at":"2026-08-16T18:00:01.729Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b0a4711cca9d2d92456955384b8855d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.735Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-72aaf1573c69224c9e905070: start","job_status":"start","queue_duration_s":1.640124,"scheduling_latency_s":1.640141} gitlab # [ 275.674016] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.382Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 275.678447] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"72aaf1573c69224c9e905070","created_at":"2026-08-16T18:00:01.729Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b0a4711cca9d2d92456955384b8855d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.735Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-72aaf1573c69224c9e905070: done: 0.012734 sec","job_status":"done","queue_duration_s":1.640124,"scheduling_latency_s":1.640141,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012734,"completed_at":"2026-08-16T18:00:03.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.720624] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6f3bc58f8d489a698fd8557f","created_at":"2026-08-16T18:00:01.744Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c35db5f10e0fc7dc630eaa96a097daac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T18:00:01.749Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6f3bc58f8d489a698fd8557f: start","job_status":"start","queue_duration_s":1.639207,"scheduling_latency_s":1.639224} gitlab # [ 275.733754] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.396Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 275.737031] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6f3bc58f8d489a698fd8557f","created_at":"2026-08-16T18:00:01.744Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c35db5f10e0fc7dc630eaa96a097daac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T18:00:01.749Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6f3bc58f8d489a698fd8557f: done: 0.012569 sec","job_status":"done","queue_duration_s":1.639207,"scheduling_latency_s":1.639224,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012569,"completed_at":"2026-08-16T18:00:03.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.776625] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"616e3b5ecb95d9f502b5bace","created_at":"2026-08-16T18:00:01.760Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.769Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-616e3b5ecb95d9f502b5bace: start","job_status":"start","queue_duration_s":1.633558,"scheduling_latency_s":1.633575} gitlab # [ 275.790921] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"616e3b5ecb95d9f502b5bace","created_at":"2026-08-16T18:00:01.760Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.769Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-616e3b5ecb95d9f502b5bace: done: 0.034296 sec","job_status":"done","queue_duration_s":1.633558,"scheduling_latency_s":1.633575,"redis_calls":24,"redis_duration_s":0.003159,"redis_read_bytes":25,"redis_write_bytes":5972,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.000229,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3805,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026288,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.034296,"completed_at":"2026-08-16T18:00:03.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.838441] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"e9cbdd7c1c0ea45bc411e087","created_at":"2026-08-16T18:00:01.774Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f25f2dbfd0cd260de0535171e24c9cc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.791Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-e9cbdd7c1c0ea45bc411e087: start","job_status":"start","queue_duration_s":1.646587,"scheduling_latency_s":1.646604} gitlab # [ 275.852828] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"e9cbdd7c1c0ea45bc411e087","created_at":"2026-08-16T18:00:01.774Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f25f2dbfd0cd260de0535171e24c9cc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.791Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-e9cbdd7c1c0ea45bc411e087: done: 0.024515 sec","job_status":"done","queue_duration_s":1.646587,"scheduling_latency_s":1.646604,"redis_calls":11,"redis_duration_s":0.001821,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000282,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038852,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.024515,"completed_at":"2026-08-16T18:00:03.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.897961] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"92e74ac7c0475bbe58aec084","created_at":"2026-08-16T18:00:01.829Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74264d9fe11b46f2d8f7848dd28acf61","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.844Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-92e74ac7c0475bbe58aec084: start","job_status":"start","queue_duration_s":1.620126,"scheduling_latency_s":1.620143} gitlab # [ 275.911575] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"92e74ac7c0475bbe58aec084","created_at":"2026-08-16T18:00:01.829Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74264d9fe11b46f2d8f7848dd28acf61","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.844Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-92e74ac7c0475bbe58aec084: done: 0.064738 sec","job_status":"done","queue_duration_s":1.620126,"scheduling_latency_s":1.620143,"redis_calls":10,"redis_duration_s":0.002312,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057172,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00516276},"duration_s":0.064738,"completed_at":"2026-08-16T18:00:03.528Z","load_balancing_strategy":"primary","db_duration_s":0.013226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 275.954758] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fafb591f47fc9bdf5f827b57","created_at":"2026-08-16T18:00:01.856Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c24c3b73653fa79408a41d6bcc6716cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.862Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fafb591f47fc9bdf5f827b57: start","job_status":"start","queue_duration_s":1.669434,"scheduling_latency_s":1.669473} gitlab # [ 275.969169] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.549Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 275.972676] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fafb591f47fc9bdf5f827b57","created_at":"2026-08-16T18:00:01.856Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c24c3b73653fa79408a41d6bcc6716cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.862Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fafb591f47fc9bdf5f827b57: done: 0.028717 sec","job_status":"done","queue_duration_s":1.669434,"scheduling_latency_s":1.669473,"redis_calls":7,"redis_duration_s":0.002602,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028717,"completed_at":"2026-08-16T18:00:03.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.013323] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"6d0183ffc107ed89a476bef6","created_at":"2026-08-16T18:00:01.882Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a71d60e5f73036f7aedd4e4dfa617520","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.890Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-6d0183ffc107ed89a476bef6: start","job_status":"start","queue_duration_s":1.672197,"scheduling_latency_s":1.672226} gitlab # [ 276.027224] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"6d0183ffc107ed89a476bef6","created_at":"2026-08-16T18:00:01.882Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a71d60e5f73036f7aedd4e4dfa617520","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.890Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-6d0183ffc107ed89a476bef6: done: 0.324244 sec","job_status":"done","queue_duration_s":1.672197,"scheduling_latency_s":1.672226,"redis_calls":562,"redis_duration_s":0.074347,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.070825,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.286906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.324244,"completed_at":"2026-08-16T18:00:03.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.068909] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d3cd276bdd93b1e2b26d1d4e","created_at":"2026-08-16T18:00:01.909Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"895fad95f279029fe2c1dbabd61e224c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.924Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d3cd276bdd93b1e2b26d1d4e: start","job_status":"start","queue_duration_s":1.963854,"scheduling_latency_s":1.963878} gitlab # [ 276.083388] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d3cd276bdd93b1e2b26d1d4e","created_at":"2026-08-16T18:00:01.909Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"895fad95f279029fe2c1dbabd61e224c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.924Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d3cd276bdd93b1e2b26d1d4e: done: 0.02216 sec","job_status":"done","queue_duration_s":1.963854,"scheduling_latency_s":1.963878,"redis_calls":10,"redis_duration_s":0.001753,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00563884,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.02216,"completed_at":"2026-08-16T18:00:03.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002222,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 276.126028] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"61c2b224109727e0c3d0079f","created_at":"2026-08-16T18:00:01.941Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aecca291a2348534098b98fd6a714a2e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.966Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-61c2b224109727e0c3d0079f: start","job_status":"start","queue_duration_s":1.945231,"scheduling_latency_s":1.945254} gitlab # [ 276.140589] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"61c2b224109727e0c3d0079f","created_at":"2026-08-16T18:00:01.941Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aecca291a2348534098b98fd6a714a2e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:01.966Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-61c2b224109727e0c3d0079f: done: 0.02813 sec","job_status":"done","queue_duration_s":1.945231,"scheduling_latency_s":1.945254,"redis_calls":10,"redis_duration_s":0.002603,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069056,"duration_s":0.02813,"completed_at":"2026-08-16T18:00:03.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.182797] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.941Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"d401ab30d03cd0994e5eafb9","created_at":"2026-08-16T18:00:01.991Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9c09f3c91492a926f8e9ce69ec048d0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.023Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-d401ab30d03cd0994e5eafb9: start","job_status":"start","queue_duration_s":1.917963,"scheduling_latency_s":1.917977} gitlab # [ 276.196574] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"d401ab30d03cd0994e5eafb9","created_at":"2026-08-16T18:00:01.991Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9c09f3c91492a926f8e9ce69ec048d0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.023Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-d401ab30d03cd0994e5eafb9: done: 0.022029 sec","job_status":"done","queue_duration_s":1.917963,"scheduling_latency_s":1.917977,"redis_calls":10,"redis_duration_s":0.0021669999999999997,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032908,"duration_s":0.022029,"completed_at":"2026-08-16T18:00:03.963Z","load_balancing_strategy":"primary","db_duration_s":0.00061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.237968] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"c0d186e6c6bfa8fa99219dd1","created_at":"2026-08-16T18:00:02.047Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfb144d58a2a998d2f87dd87a10871ad","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.071Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-c0d186e6c6bfa8fa99219dd1: start","job_status":"start","queue_duration_s":1.893949,"scheduling_latency_s":1.893964} gitlab # [ 276.252779] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"c0d186e6c6bfa8fa99219dd1","created_at":"2026-08-16T18:00:02.047Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfb144d58a2a998d2f87dd87a10871ad","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.071Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-c0d186e6c6bfa8fa99219dd1: done: 0.019169 sec","job_status":"done","queue_duration_s":1.893949,"scheduling_latency_s":1.893964,"redis_calls":11,"redis_duration_s":0.003226,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000932,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001512,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034064,"duration_s":0.019169,"completed_at":"2026-08-16T18:00:03.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.297792] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:03.985Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"77e2ee6b758ba1a1f7b88bc0","created_at":"2026-08-16T18:00:02.093Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe460c93d0eec0cd2ba96f420cc24890","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T18:00:02.104Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-77e2ee6b758ba1a1f7b88bc0: start","job_status":"start","queue_duration_s":1.880925,"scheduling_latency_s":1.880942} gitlab # [ 276.337624] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"77e2ee6b758ba1a1f7b88bc0","created_at":"2026-08-16T18:00:02.093Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe460c93d0eec0cd2ba96f420cc24890","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T18:00:02.104Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-77e2ee6b758ba1a1f7b88bc0: done: 0.022039 sec","job_status":"done","queue_duration_s":1.880925,"scheduling_latency_s":1.880942,"redis_calls":8,"redis_duration_s":0.00202,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000221,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022039,"completed_at":"2026-08-16T18:00:04.007Z","load_balancing_strategy":"primary","db_duration_s":0.002678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.404170] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"95784d54340ac77ab5acea52","created_at":"2026-08-16T18:00:02.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55bef9761d05342b2232910626e3f567","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.137Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-95784d54340ac77ab5acea52: start","job_status":"start","queue_duration_s":1.871887,"scheduling_latency_s":1.871903} gitlab # [ 276.419023] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"95784d54340ac77ab5acea52","created_at":"2026-08-16T18:00:02.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55bef9761d05342b2232910626e3f567","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.137Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-95784d54340ac77ab5acea52: done: 0.100236 sec","job_status":"done","queue_duration_s":1.871887,"scheduling_latency_s":1.871903,"redis_calls":12,"redis_duration_s":0.0034159999999999998,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000551,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00132,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00066724,"exclusive_lock_hold_duration_s":0.01289004,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.100236,"completed_at":"2026-08-16T18:00:04.109Z","load_balancing_strategy":"primary","db_duration_s":0.007745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.462349] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"a676bc8b5fdfd2d4f76a5153","created_at":"2026-08-16T18:00:02.151Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.174Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-a676bc8b5fdfd2d4f76a5153: start","job_status":"start","queue_duration_s":1.937011,"scheduling_latency_s":1.937026} gitlab # [ 276.475900] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"a676bc8b5fdfd2d4f76a5153","created_at":"2026-08-16T18:00:02.151Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.174Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-a676bc8b5fdfd2d4f76a5153: done: 0.104152 sec","job_status":"done","queue_duration_s":1.937011,"scheduling_latency_s":1.937026,"redis_calls":65,"redis_duration_s":0.013593,"redis_read_bytes":114,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001111,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000687,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.011148,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002472,"duration_s":0.104152,"completed_at":"2026-08-16T18:00:04.215Z","load_balancing_strategy":"primary","db_duration_s":0.001322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.519586] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"a920be2438185d873831f130","created_at":"2026-08-16T18:00:02.193Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ae162965af630927c37aa85ed924557","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.208Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-a920be2438185d873831f130: start","job_status":"start","queue_duration_s":2.007398,"scheduling_latency_s":2.007413} gitlab # [ 276.533073] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"a920be2438185d873831f130","created_at":"2026-08-16T18:00:02.193Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ae162965af630927c37aa85ed924557","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.208Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-a920be2438185d873831f130: done: 0.025037 sec","job_status":"done","queue_duration_s":2.007398,"scheduling_latency_s":2.007413,"redis_calls":11,"redis_duration_s":0.001525,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024472,"duration_s":0.025037,"completed_at":"2026-08-16T18:00:04.241Z","load_balancing_strategy":"primary","db_duration_s":0.002723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.573721] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"372451686306f9bff83ef916","created_at":"2026-08-16T18:00:02.245Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"424ad5281cb53e28ab10600b4a3e802c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.262Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-372451686306f9bff83ef916: start","job_status":"start","queue_duration_s":1.980377,"scheduling_latency_s":1.980393} gitlab # [ 276.588007] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"372451686306f9bff83ef916","created_at":"2026-08-16T18:00:02.245Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"424ad5281cb53e28ab10600b4a3e802c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.262Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-372451686306f9bff83ef916: done: 0.197561 sec","job_status":"done","queue_duration_s":1.980377,"scheduling_latency_s":1.980393,"redis_calls":12,"redis_duration_s":0.0018960000000000001,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051774,"exclusive_lock_hold_duration_s":0.17406758,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.197561,"completed_at":"2026-08-16T18:00:04.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019376,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 276.632065] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e69e85d30271805969aba572","created_at":"2026-08-16T18:00:02.277Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da2ff23a9c6ef66cd703a0f192189d8b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.283Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e69e85d30271805969aba572: start","job_status":"start","queue_duration_s":2.15845,"scheduling_latency_s":2.158467} gitlab # [ 276.646161] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.460Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e69e85d30271805969aba572","created_at":"2026-08-16T18:00:02.277Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da2ff23a9c6ef66cd703a0f192189d8b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.283Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e69e85d30271805969aba572: done: 0.019064 sec","job_status":"done","queue_duration_s":2.15845,"scheduling_latency_s":2.158467,"redis_calls":7,"redis_duration_s":0.001044,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019064,"completed_at":"2026-08-16T18:00:04.460Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.687146] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"edf2dcfe511f755906853af4","created_at":"2026-08-16T18:00:02.296Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.302Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-edf2dcfe511f755906853af4: start","job_status":"start","queue_duration_s":2.15976,"scheduling_latency_s":2.159778} gitlab # [ 276.701030] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"edf2dcfe511f755906853af4","created_at":"2026-08-16T18:00:02.296Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.302Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-edf2dcfe511f755906853af4: done: 0.101324 sec","job_status":"done","queue_duration_s":2.15976,"scheduling_latency_s":2.159778,"redis_calls":60,"redis_duration_s":0.009131,"redis_read_bytes":109,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000554,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.00817,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101324,"completed_at":"2026-08-16T18:00:04.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.741918] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"84be039f40b23bd07d4e6d3b","created_at":"2026-08-16T18:00:02.322Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5119ffa3a8024c99813d28096ecae0f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.342Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-84be039f40b23bd07d4e6d3b: start","job_status":"start","queue_duration_s":2.222692,"scheduling_latency_s":2.222709} gitlab # [ 276.755317] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"84be039f40b23bd07d4e6d3b","created_at":"2026-08-16T18:00:02.322Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5119ffa3a8024c99813d28096ecae0f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.342Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-84be039f40b23bd07d4e6d3b: done: 0.027097 sec","job_status":"done","queue_duration_s":2.222692,"scheduling_latency_s":2.222709,"redis_calls":10,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026828,"duration_s":0.027097,"completed_at":"2026-08-16T18:00:04.592Z","load_balancing_strategy":"primary","db_duration_s":0.004033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.796548] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2d56bdffcd4b0b45f1377d27","created_at":"2026-08-16T18:00:02.355Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.382Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2d56bdffcd4b0b45f1377d27: start","job_status":"start","queue_duration_s":2.210454,"scheduling_latency_s":2.21047} gitlab # [ 276.809881] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2d56bdffcd4b0b45f1377d27","created_at":"2026-08-16T18:00:02.355Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.382Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2d56bdffcd4b0b45f1377d27: done: 0.025075 sec","job_status":"done","queue_duration_s":2.210454,"scheduling_latency_s":2.21047,"redis_calls":14,"redis_duration_s":0.001994,"redis_read_bytes":17,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000199,"redis_queues_read_bytes":4,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025075,"completed_at":"2026-08-16T18:00:04.618Z","load_balancing_strategy":"primary","db_duration_s":0.001128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.851377] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.619Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"72b1c47763621c09cdbb56f8","created_at":"2026-08-16T18:00:02.445Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"36579c3b4f947f0c07f9e00276fd2f94","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.460Z","job_size_bytes":3,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-72b1c47763621c09cdbb56f8: start","job_status":"start","queue_duration_s":2.158803,"scheduling_latency_s":2.15882} gitlab # [ 276.865311] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.638Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"72b1c47763621c09cdbb56f8","created_at":"2026-08-16T18:00:02.445Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"36579c3b4f947f0c07f9e00276fd2f94","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.460Z","job_size_bytes":3,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-72b1c47763621c09cdbb56f8: done: 0.01948 sec","job_status":"done","queue_duration_s":2.158803,"scheduling_latency_s":2.15882,"redis_calls":10,"redis_duration_s":0.0013570000000000001,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023886,"duration_s":0.01948,"completed_at":"2026-08-16T18:00:04.638Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.908458] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ab71626ff8b42b9340260053","created_at":"2026-08-16T18:00:02.511Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f890f0da8b3c5b349db006c475e9848","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.522Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ab71626ff8b42b9340260053: start","job_status":"start","queue_duration_s":2.118034,"scheduling_latency_s":2.118051} gitlab # [ 276.921652] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.655Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ab71626ff8b42b9340260053","created_at":"2026-08-16T18:00:02.511Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f890f0da8b3c5b349db006c475e9848","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.522Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ab71626ff8b42b9340260053: done: 0.015555 sec","job_status":"done","queue_duration_s":2.118034,"scheduling_latency_s":2.118051,"redis_calls":9,"redis_duration_s":0.001294,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047368,"exclusive_lock_hold_duration_s":0.00306718,"duration_s":0.015555,"completed_at":"2026-08-16T18:00:04.655Z","load_balancing_strategy":"primary","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.962122] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"fb84199bf840e6b1f4cb2c33","created_at":"2026-08-16T18:00:02.534Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cc8821f976aadf9f46d5b7387c84f57","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.556Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-fb84199bf840e6b1f4cb2c33: start","job_status":"start","queue_duration_s":2.10054,"scheduling_latency_s":2.100557} gitlab # [ 276.975373] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"fb84199bf840e6b1f4cb2c33","created_at":"2026-08-16T18:00:02.534Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cc8821f976aadf9f46d5b7387c84f57","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.556Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-fb84199bf840e6b1f4cb2c33: done: 0.022369 sec","job_status":"done","queue_duration_s":2.10054,"scheduling_latency_s":2.100557,"redis_calls":12,"redis_duration_s":0.001615,"redis_read_bytes":11,"redis_write_bytes":1392,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024874,"duration_s":0.022369,"completed_at":"2026-08-16T18:00:04.679Z","load_balancing_strategy":"primary","db_duration_s":0.000846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.016277] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.680Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f2fc2c92e8b72b6d6a3d789e","created_at":"2026-08-16T18:00:02.567Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"842b1cb171a660cea8cbf0b0bbd88926","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.579Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f2fc2c92e8b72b6d6a3d789e: start","job_status":"start","queue_duration_s":2.100918,"scheduling_latency_s":2.100934} gitlab # [ 277.030669] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f2fc2c92e8b72b6d6a3d789e","created_at":"2026-08-16T18:00:02.567Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"842b1cb171a660cea8cbf0b0bbd88926","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.579Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f2fc2c92e8b72b6d6a3d789e: done: 0.012615 sec","job_status":"done","queue_duration_s":2.100918,"scheduling_latency_s":2.100934,"redis_calls":7,"redis_duration_s":0.000998,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012615,"completed_at":"2026-08-16T18:00:04.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.070916] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"46f0ad26a6788a4a0746481f","created_at":"2026-08-16T18:00:02.601Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ef09e62222675592a516937d4632a34","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.611Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-46f0ad26a6788a4a0746481f: start","job_status":"start","queue_duration_s":2.083086,"scheduling_latency_s":2.083103} gitlab # [ 277.086087] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"46f0ad26a6788a4a0746481f","created_at":"2026-08-16T18:00:02.601Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ef09e62222675592a516937d4632a34","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.611Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-46f0ad26a6788a4a0746481f: done: 0.0206 sec","job_status":"done","queue_duration_s":2.083086,"scheduling_latency_s":2.083103,"redis_calls":7,"redis_duration_s":0.001015,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.0206,"completed_at":"2026-08-16T18:00:04.715Z","load_balancing_strategy":"primary","db_duration_s":0.006958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.126575] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c06f20e2f048ec8cb1d1c731","created_at":"2026-08-16T18:00:02.631Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec53f79148127f7a2718010d4e1e4619","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T18:00:02.635Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c06f20e2f048ec8cb1d1c731: start","job_status":"start","queue_duration_s":2.081096,"scheduling_latency_s":2.081112} gitlab # [ 277.140119] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.723Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 277.143660] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c06f20e2f048ec8cb1d1c731","created_at":"2026-08-16T18:00:02.631Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec53f79148127f7a2718010d4e1e4619","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T18:00:02.635Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c06f20e2f048ec8cb1d1c731: done: 0.012268 sec","job_status":"done","queue_duration_s":2.081096,"scheduling_latency_s":2.081112,"redis_calls":7,"redis_duration_s":0.000967,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012268,"completed_at":"2026-08-16T18:00:04.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.183137] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5787a2a1d664d8e5712389d2","created_at":"2026-08-16T18:00:02.654Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a469d62ad9502c5fa14df4934ce6618b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.668Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5787a2a1d664d8e5712389d2: start","job_status":"start","queue_duration_s":2.061499,"scheduling_latency_s":2.061516} gitlab # [ 277.197551] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5787a2a1d664d8e5712389d2","created_at":"2026-08-16T18:00:02.654Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a469d62ad9502c5fa14df4934ce6618b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.668Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5787a2a1d664d8e5712389d2: done: 0.023361 sec","job_status":"done","queue_duration_s":2.061499,"scheduling_latency_s":2.061516,"redis_calls":12,"redis_duration_s":0.001676,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048654,"exclusive_lock_hold_duration_s":0.00506574,"duration_s":0.023361,"completed_at":"2026-08-16T18:00:04.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.239434] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"aa358a25a980afa8dd266758","created_at":"2026-08-16T18:00:02.677Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bc7558ea6ff1cf64ca79abd5a340dcc","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.701Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-aa358a25a980afa8dd266758: start","job_status":"start","queue_duration_s":2.05345,"scheduling_latency_s":2.053466} gitlab # [ 277.252901] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"aa358a25a980afa8dd266758","created_at":"2026-08-16T18:00:02.677Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bc7558ea6ff1cf64ca79abd5a340dcc","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.701Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-aa358a25a980afa8dd266758: done: 0.028038 sec","job_status":"done","queue_duration_s":2.05345,"scheduling_latency_s":2.053466,"redis_calls":10,"redis_duration_s":0.001362,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243,"duration_s":0.028038,"completed_at":"2026-08-16T18:00:04.782Z","load_balancing_strategy":"primary","db_duration_s":0.003628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.294783] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"371a9212b5e4a9c31e730d81","created_at":"2026-08-16T18:00:02.708Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27de1c29243c7b19d69e1624f6bccfb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.717Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-371a9212b5e4a9c31e730d81: start","job_status":"start","queue_duration_s":2.066179,"scheduling_latency_s":2.066195} gitlab # [ 277.309763] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"371a9212b5e4a9c31e730d81","created_at":"2026-08-16T18:00:02.708Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27de1c29243c7b19d69e1624f6bccfb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.717Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-371a9212b5e4a9c31e730d81: done: 0.013614 sec","job_status":"done","queue_duration_s":2.066179,"scheduling_latency_s":2.066195,"redis_calls":7,"redis_duration_s":0.001033,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013614,"completed_at":"2026-08-16T18:00:04.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.350788] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"ca3a28ab1942caa8fc884ae2","created_at":"2026-08-16T18:00:02.726Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a5387fa08dd33181aaa18b079249a3a","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.752Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-ca3a28ab1942caa8fc884ae2: start","job_status":"start","queue_duration_s":2.046785,"scheduling_latency_s":2.046801} gitlab # [ 277.364270] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"ca3a28ab1942caa8fc884ae2","created_at":"2026-08-16T18:00:02.726Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a5387fa08dd33181aaa18b079249a3a","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.752Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-ca3a28ab1942caa8fc884ae2: done: 0.025831 sec","job_status":"done","queue_duration_s":2.046785,"scheduling_latency_s":2.046801,"redis_calls":12,"redis_duration_s":0.0018930000000000002,"redis_read_bytes":11,"redis_write_bytes":1420,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000857,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":638,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024048,"duration_s":0.025831,"completed_at":"2026-08-16T18:00:04.824Z","load_balancing_strategy":"primary","db_duration_s":0.00245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.405715] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"ac0867257e72ae4cae16615c","created_at":"2026-08-16T18:00:02.775Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.793Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-ac0867257e72ae4cae16615c: start","job_status":"start","queue_duration_s":2.031957,"scheduling_latency_s":2.031972} gitlab # [ 277.420170] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"ac0867257e72ae4cae16615c","created_at":"2026-08-16T18:00:02.775Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.793Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-ac0867257e72ae4cae16615c: done: 0.047438 sec","job_status":"done","queue_duration_s":2.031957,"scheduling_latency_s":2.031972,"redis_calls":28,"redis_duration_s":0.003905,"redis_read_bytes":37,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000273,"redis_queues_read_bytes":4,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.002213,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023906,"duration_s":0.047438,"completed_at":"2026-08-16T18:00:04.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.463693] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"822af93ef8fdd60ebb51bc9e","created_at":"2026-08-16T18:00:02.815Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65242ab7542fdc82b882cbedacb620e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.824Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-822af93ef8fdd60ebb51bc9e: start","job_status":"start","queue_duration_s":2.049556,"scheduling_latency_s":2.049574} gitlab # [ 277.478398] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.881Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 277.481559] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"822af93ef8fdd60ebb51bc9e","created_at":"2026-08-16T18:00:02.815Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65242ab7542fdc82b882cbedacb620e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.824Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-822af93ef8fdd60ebb51bc9e: done: 0.012256 sec","job_status":"done","queue_duration_s":2.049556,"scheduling_latency_s":2.049574,"redis_calls":7,"redis_duration_s":0.0009880000000000002,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012256,"completed_at":"2026-08-16T18:00:04.886Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.523304] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"64caf1243adc3b1346ef1189","created_at":"2026-08-16T18:00:02.886Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"449d241730a61003a3f5e6ccec090865","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.901Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-64caf1243adc3b1346ef1189: start","job_status":"start","queue_duration_s":1.985964,"scheduling_latency_s":1.98598} gitlab # [ 277.537845] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"64caf1243adc3b1346ef1189","created_at":"2026-08-16T18:00:02.886Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"449d241730a61003a3f5e6ccec090865","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.901Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-64caf1243adc3b1346ef1189: done: 0.016358 sec","job_status":"done","queue_duration_s":1.985964,"scheduling_latency_s":1.98598,"redis_calls":9,"redis_duration_s":0.001361,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047578,"exclusive_lock_hold_duration_s":0.00252212,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016358,"completed_at":"2026-08-16T18:00:04.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.579345] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"54e1e14273e4133b4d0b9507","created_at":"2026-08-16T18:00:02.928Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94fc0278ae02999dcd319bfe8259422f","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.947Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-54e1e14273e4133b4d0b9507: start","job_status":"start","queue_duration_s":1.95739,"scheduling_latency_s":1.957407} gitlab # [ 277.593135] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"54e1e14273e4133b4d0b9507","created_at":"2026-08-16T18:00:02.928Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94fc0278ae02999dcd319bfe8259422f","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.947Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-54e1e14273e4133b4d0b9507: done: 0.019329 sec","job_status":"done","queue_duration_s":1.95739,"scheduling_latency_s":1.957407,"redis_calls":10,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024948,"duration_s":0.019329,"completed_at":"2026-08-16T18:00:04.924Z","load_balancing_strategy":"primary","db_duration_s":0.000698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.635038] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"ad5a338ea104b14754ae65a7","created_at":"2026-08-16T18:00:02.960Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78ebc0070268a2692bf5242cacc34f03","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.976Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-ad5a338ea104b14754ae65a7: start","job_status":"start","queue_duration_s":1.949539,"scheduling_latency_s":1.949555} gitlab # [ 277.649455] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"ad5a338ea104b14754ae65a7","created_at":"2026-08-16T18:00:02.960Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-4df158b8ce374198","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78ebc0070268a2692bf5242cacc34f03","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:02.976Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-ad5a338ea104b14754ae65a7: done: 0.02961 sec","job_status":"done","queue_duration_s":1.949539,"scheduling_latency_s":1.949555,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":9,"redis_write_bytes":1055,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028744,"duration_s":0.02961,"completed_at":"2026-08-16T18:00:04.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.691112] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.956Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"dbaa382215b9686a288368df","created_at":"2026-08-16T18:00:03.004Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-fd4934ffa8384f93","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ee453dfbb83fa6e268290cfaa0c6504a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.034Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-dbaa382215b9686a288368df: start","job_status":"start","queue_duration_s":1.922046,"scheduling_latency_s":1.922063} gitlab # [ 277.707838] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.979Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"dbaa382215b9686a288368df","created_at":"2026-08-16T18:00:03.004Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-fd4934ffa8384f93","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ee453dfbb83fa6e268290cfaa0c6504a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.034Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-dbaa382215b9686a288368df: done: 0.022868 sec","job_status":"done","queue_duration_s":1.922046,"scheduling_latency_s":1.922063,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024756,"duration_s":0.022868,"completed_at":"2026-08-16T18:00:04.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.751074] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:04.980Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"5b34a31d8f28bb97291cec9c","created_at":"2026-08-16T18:00:03.036Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-fd4934ffa8384f93","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ee453dfbb83fa6e268290cfaa0c6504a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.046Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-5b34a31d8f28bb97291cec9c: start","job_status":"start","queue_duration_s":1.933972,"scheduling_latency_s":1.933989} gitlab # [ 277.766320] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.002Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"5b34a31d8f28bb97291cec9c","created_at":"2026-08-16T18:00:03.036Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-fd4934ffa8384f93","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ee453dfbb83fa6e268290cfaa0c6504a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.046Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-5b34a31d8f28bb97291cec9c: done: 0.022039 sec","job_status":"done","queue_duration_s":1.933972,"scheduling_latency_s":1.933989,"redis_calls":10,"redis_duration_s":0.001409,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002469,"duration_s":0.022039,"completed_at":"2026-08-16T18:00:05.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.809116] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"70749f374b06925706e36ce9","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-70749f374b06925706e36ce9: start","job_status":"start","queue_duration_s":1.574262,"scheduling_latency_s":1.574278} gitlab # [ 277.821612] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"70749f374b06925706e36ce9","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-70749f374b06925706e36ce9: done: 0.031028 sec","job_status":"done","queue_duration_s":1.574262,"scheduling_latency_s":1.574278,"redis_calls":18,"redis_duration_s":0.0026769999999999997,"redis_read_bytes":39,"redis_write_bytes":2116,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":471,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":34,"redis_shared_state_write_bytes":1324,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028776,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":1,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":1,"duration_s":0.031028,"completed_at":"2026-08-16T18:00:05.034Z","load_balancing_strategy":"primary","db_duration_s":0.005905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.867160] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"29f31724856bc855cfcd536a","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-29f31724856bc855cfcd536a: start","job_status":"start","queue_duration_s":1.606436,"scheduling_latency_s":1.606452} gitlab # [ 277.880099] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"29f31724856bc855cfcd536a","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-29f31724856bc855cfcd536a: done: 0.022671 sec","job_status":"done","queue_duration_s":1.606436,"scheduling_latency_s":1.606452,"redis_calls":15,"redis_duration_s":0.001894,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001327,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":2,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":2,"duration_s":0.022671,"completed_at":"2026-08-16T18:00:05.058Z","load_balancing_strategy":"primary","db_duration_s":0.004073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.923255] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"89635514c4ce7f28bb4caee4","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-89635514c4ce7f28bb4caee4: start","job_status":"start","queue_duration_s":1.63018,"scheduling_latency_s":1.630197} gitlab # [ 277.936024] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"89635514c4ce7f28bb4caee4","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-89635514c4ce7f28bb4caee4: done: 0.026008 sec","job_status":"done","queue_duration_s":1.63018,"scheduling_latency_s":1.630197,"redis_calls":15,"redis_duration_s":0.0018999999999999998,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":1,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":1,"duration_s":0.026008,"completed_at":"2026-08-16T18:00:05.085Z","load_balancing_strategy":"primary","db_duration_s":0.004236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.978470] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"3b08c892365219fb6d07bb0d","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-3b08c892365219fb6d07bb0d: start","job_status":"start","queue_duration_s":1.65728,"scheduling_latency_s":1.657297} gitlab # [ 277.991305] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"3b08c892365219fb6d07bb0d","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-3b08c892365219fb6d07bb0d: done: 0.022327 sec","job_status":"done","queue_duration_s":1.65728,"scheduling_latency_s":1.657297,"redis_calls":15,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":0,"duration_s":0.022327,"completed_at":"2026-08-16T18:00:05.108Z","load_balancing_strategy":"primary","db_duration_s":0.004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.033851] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"8d5e05f09e991d9496b11e18","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-8d5e05f09e991d9496b11e18: start","job_status":"start","queue_duration_s":1.680746,"scheduling_latency_s":1.680765} gitlab # [ 278.046345] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"8d5e05f09e991d9496b11e18","created_at":"2026-08-16T18:00:03.415Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-dbe1f4303b924e2c","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"699ebc0af017f46c80715947ace2bd0e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:03.429Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-8d5e05f09e991d9496b11e18: done: 0.022823 sec","job_status":"done","queue_duration_s":1.680746,"scheduling_latency_s":1.680765,"redis_calls":15,"redis_duration_s":0.001919,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001339,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":0,"duration_s":0.022823,"completed_at":"2026-08-16T18:00:05.132Z","load_balancing_strategy":"primary","db_duration_s":0.003939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.088184] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"247b5ef4e370f97f61d1b9e6","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-247b5ef4e370f97f61d1b9e6: start","job_status":"start","queue_duration_s":0.928445,"scheduling_latency_s":0.928462} gitlab # [ 278.100393] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"247b5ef4e370f97f61d1b9e6","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-247b5ef4e370f97f61d1b9e6: done: 0.031874 sec","job_status":"done","queue_duration_s":0.928445,"scheduling_latency_s":0.928462,"redis_calls":13,"redis_duration_s":0.001726,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023766,"duration_s":0.031874,"completed_at":"2026-08-16T18:00:05.165Z","load_balancing_strategy":"primary","db_duration_s":0.00731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.141286] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"27734b19caadc709a666977a","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-27734b19caadc709a666977a: start","job_status":"start","queue_duration_s":0.96145,"scheduling_latency_s":0.961466} gitlab # [ 278.153486] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"27734b19caadc709a666977a","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-27734b19caadc709a666977a: done: 0.018829 sec","job_status":"done","queue_duration_s":0.96145,"scheduling_latency_s":0.961466,"redis_calls":10,"redis_duration_s":0.001351,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018829,"completed_at":"2026-08-16T18:00:05.185Z","load_balancing_strategy":"primary","db_duration_s":0.002502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.191772] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bfd3ba1cbb0d550fdf92ba13","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bfd3ba1cbb0d550fdf92ba13: start","job_status":"start","queue_duration_s":0.981538,"scheduling_latency_s":0.981555} gitlab # [ 278.204387] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bfd3ba1cbb0d550fdf92ba13","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bfd3ba1cbb0d550fdf92ba13: done: 0.019081 sec","job_status":"done","queue_duration_s":0.981538,"scheduling_latency_s":0.981555,"redis_calls":10,"redis_duration_s":0.001467,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019081,"completed_at":"2026-08-16T18:00:05.206Z","load_balancing_strategy":"primary","db_duration_s":0.002786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.242686] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"498629768e01e10976f15bae","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-498629768e01e10976f15bae: start","job_status":"start","queue_duration_s":1.001746,"scheduling_latency_s":1.001764} gitlab # [ 278.255029] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"498629768e01e10976f15bae","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-498629768e01e10976f15bae: done: 0.018721 sec","job_status":"done","queue_duration_s":1.001746,"scheduling_latency_s":1.001764,"redis_calls":10,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018721,"completed_at":"2026-08-16T18:00:05.226Z","load_balancing_strategy":"primary","db_duration_s":0.00266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.293625] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"66b96039007f1fa9901803e1","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-66b96039007f1fa9901803e1: start","job_status":"start","queue_duration_s":1.021666,"scheduling_latency_s":1.021683} gitlab # [ 278.305839] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"66b96039007f1fa9901803e1","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-66b96039007f1fa9901803e1: done: 0.018855 sec","job_status":"done","queue_duration_s":1.021666,"scheduling_latency_s":1.021683,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018855,"completed_at":"2026-08-16T18:00:05.246Z","load_balancing_strategy":"primary","db_duration_s":0.002365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.345624] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9eb941665e7681a570c55a5e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9eb941665e7681a570c55a5e: start","job_status":"start","queue_duration_s":1.041651,"scheduling_latency_s":1.041668} gitlab # [ 278.357713] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9eb941665e7681a570c55a5e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9eb941665e7681a570c55a5e: done: 0.018819 sec","job_status":"done","queue_duration_s":1.041651,"scheduling_latency_s":1.041668,"redis_calls":10,"redis_duration_s":0.001579,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018819,"completed_at":"2026-08-16T18:00:05.266Z","load_balancing_strategy":"primary","db_duration_s":0.00239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.396252] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dff53f60200f2087ff6d5927","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dff53f60200f2087ff6d5927: start","job_status":"start","queue_duration_s":1.061721,"scheduling_latency_s":1.061739} gitlab # [ 278.408141] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dff53f60200f2087ff6d5927","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dff53f60200f2087ff6d5927: done: 0.018984 sec","job_status":"done","queue_duration_s":1.061721,"scheduling_latency_s":1.061739,"redis_calls":10,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000827,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018984,"completed_at":"2026-08-16T18:00:05.286Z","load_balancing_strategy":"primary","db_duration_s":0.002411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.447068] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b6c43226d84e30d745b1d848","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b6c43226d84e30d745b1d848: start","job_status":"start","queue_duration_s":1.082008,"scheduling_latency_s":1.082024} gitlab # [ 278.459173] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b6c43226d84e30d745b1d848","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b6c43226d84e30d745b1d848: done: 0.018049 sec","job_status":"done","queue_duration_s":1.082008,"scheduling_latency_s":1.082024,"redis_calls":10,"redis_duration_s":0.001352,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018049,"completed_at":"2026-08-16T18:00:05.305Z","load_balancing_strategy":"primary","db_duration_s":0.002193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.497389] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"83dbd69acafc2e8fd2ca8076","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-83dbd69acafc2e8fd2ca8076: start","job_status":"start","queue_duration_s":1.101175,"scheduling_latency_s":1.101192} gitlab # [ 278.509586] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"83dbd69acafc2e8fd2ca8076","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-83dbd69acafc2e8fd2ca8076: done: 0.018289 sec","job_status":"done","queue_duration_s":1.101175,"scheduling_latency_s":1.101192,"redis_calls":10,"redis_duration_s":0.001445,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018289,"completed_at":"2026-08-16T18:00:05.325Z","load_balancing_strategy":"primary","db_duration_s":0.002336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.548602] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"274ee959154692a83352fb20","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-274ee959154692a83352fb20: start","job_status":"start","queue_duration_s":1.120681,"scheduling_latency_s":1.120697} gitlab # [ 278.560695] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"274ee959154692a83352fb20","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-274ee959154692a83352fb20: done: 0.018742 sec","job_status":"done","queue_duration_s":1.120681,"scheduling_latency_s":1.120697,"redis_calls":10,"redis_duration_s":0.00175,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018742,"completed_at":"2026-08-16T18:00:05.344Z","load_balancing_strategy":"primary","db_duration_s":0.002261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.598687] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1c03e4225f3e98b1749e66ab","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1c03e4225f3e98b1749e66ab: start","job_status":"start","queue_duration_s":1.140864,"scheduling_latency_s":1.140882} gitlab # [ 278.610841] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1c03e4225f3e98b1749e66ab","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1c03e4225f3e98b1749e66ab: done: 0.01938 sec","job_status":"done","queue_duration_s":1.140864,"scheduling_latency_s":1.140882,"redis_calls":10,"redis_duration_s":0.001401,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01938,"completed_at":"2026-08-16T18:00:05.365Z","load_balancing_strategy":"primary","db_duration_s":0.002394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.649040] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0ba4a06a0dc7ec3aa531b310","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0ba4a06a0dc7ec3aa531b310: start","job_status":"start","queue_duration_s":1.161365,"scheduling_latency_s":1.161381} gitlab # [ 278.660922] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0ba4a06a0dc7ec3aa531b310","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0ba4a06a0dc7ec3aa531b310: done: 0.020036 sec","job_status":"done","queue_duration_s":1.161365,"scheduling_latency_s":1.161381,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020036,"completed_at":"2026-08-16T18:00:05.386Z","load_balancing_strategy":"primary","db_duration_s":0.002468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.699032] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6d0461dd3364d1463750f3aa","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6d0461dd3364d1463750f3aa: start","job_status":"start","queue_duration_s":1.182497,"scheduling_latency_s":1.182514} gitlab # [ 278.711382] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6d0461dd3364d1463750f3aa","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6d0461dd3364d1463750f3aa: done: 0.02016 sec","job_status":"done","queue_duration_s":1.182497,"scheduling_latency_s":1.182514,"redis_calls":10,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02016,"completed_at":"2026-08-16T18:00:05.408Z","load_balancing_strategy":"primary","db_duration_s":0.002392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.750765] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0e79aa68754c073aaaf5e88d","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0e79aa68754c073aaaf5e88d: start","job_status":"start","queue_duration_s":1.203767,"scheduling_latency_s":1.203784} gitlab # [ 278.763049] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0e79aa68754c073aaaf5e88d","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0e79aa68754c073aaaf5e88d: done: 0.019063 sec","job_status":"done","queue_duration_s":1.203767,"scheduling_latency_s":1.203784,"redis_calls":10,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019063,"completed_at":"2026-08-16T18:00:05.428Z","load_balancing_strategy":"primary","db_duration_s":0.002271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.801380] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b0873df3a9b4f0e3075c2d94","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b0873df3a9b4f0e3075c2d94: start","job_status":"start","queue_duration_s":1.224273,"scheduling_latency_s":1.224291} gitlab # [ 278.813784] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b0873df3a9b4f0e3075c2d94","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b0873df3a9b4f0e3075c2d94: done: 0.0192 sec","job_status":"done","queue_duration_s":1.224273,"scheduling_latency_s":1.224291,"redis_calls":10,"redis_duration_s":0.001392,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000815,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0192,"completed_at":"2026-08-16T18:00:05.449Z","load_balancing_strategy":"primary","db_duration_s":0.002297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.851667] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f9cc6079c8cae1f619461ce2","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f9cc6079c8cae1f619461ce2: start","job_status":"start","queue_duration_s":1.24489,"scheduling_latency_s":1.244907} gitlab # [ 278.864279] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f9cc6079c8cae1f619461ce2","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f9cc6079c8cae1f619461ce2: done: 0.019614 sec","job_status":"done","queue_duration_s":1.24489,"scheduling_latency_s":1.244907,"redis_calls":10,"redis_duration_s":0.0019039999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001339,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019614,"completed_at":"2026-08-16T18:00:05.470Z","load_balancing_strategy":"primary","db_duration_s":0.002407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.902630] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"24d386bf2ac61fc769848018","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-24d386bf2ac61fc769848018: start","job_status":"start","queue_duration_s":1.266056,"scheduling_latency_s":1.266074} gitlab # [ 278.914958] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"24d386bf2ac61fc769848018","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-24d386bf2ac61fc769848018: done: 0.020061 sec","job_status":"done","queue_duration_s":1.266056,"scheduling_latency_s":1.266074,"redis_calls":10,"redis_duration_s":0.001464,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020061,"completed_at":"2026-08-16T18:00:05.491Z","load_balancing_strategy":"primary","db_duration_s":0.002428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.954427] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a356ef08a009c626fbce6c4b","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a356ef08a009c626fbce6c4b: start","job_status":"start","queue_duration_s":1.287284,"scheduling_latency_s":1.287301} gitlab # [ 278.966707] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a356ef08a009c626fbce6c4b","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a356ef08a009c626fbce6c4b: done: 0.020217 sec","job_status":"done","queue_duration_s":1.287284,"scheduling_latency_s":1.287301,"redis_calls":10,"redis_duration_s":0.001352,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000785,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020217,"completed_at":"2026-08-16T18:00:05.513Z","load_balancing_strategy":"primary","db_duration_s":0.002926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.005331] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"940fe5064668ef149f15fef1","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-940fe5064668ef149f15fef1: start","job_status":"start","queue_duration_s":1.308548,"scheduling_latency_s":1.308564} gitlab # [ 279.017616] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"940fe5064668ef149f15fef1","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-940fe5064668ef149f15fef1: done: 0.020482 sec","job_status":"done","queue_duration_s":1.308548,"scheduling_latency_s":1.308564,"redis_calls":10,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020482,"completed_at":"2026-08-16T18:00:05.534Z","load_balancing_strategy":"primary","db_duration_s":0.002616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.055758] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9b3e68af75800bf0e4ed7bde","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9b3e68af75800bf0e4ed7bde: start","job_status":"start","queue_duration_s":1.330125,"scheduling_latency_s":1.330141} gitlab # [ 279.067981] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9b3e68af75800bf0e4ed7bde","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9b3e68af75800bf0e4ed7bde: done: 0.019716 sec","job_status":"done","queue_duration_s":1.330125,"scheduling_latency_s":1.330141,"redis_calls":10,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019716,"completed_at":"2026-08-16T18:00:05.555Z","load_balancing_strategy":"primary","db_duration_s":0.002311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.106817] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"89c8872bb792faa0a0d35f10","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-89c8872bb792faa0a0d35f10: start","job_status":"start","queue_duration_s":1.350925,"scheduling_latency_s":1.350941} gitlab # [ 279.119324] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"89c8872bb792faa0a0d35f10","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-89c8872bb792faa0a0d35f10: done: 0.030963 sec","job_status":"done","queue_duration_s":1.350925,"scheduling_latency_s":1.350941,"redis_calls":10,"redis_duration_s":0.002098,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030963,"completed_at":"2026-08-16T18:00:05.587Z","load_balancing_strategy":"primary","db_duration_s":0.011639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.158977] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"47f9584a6b23254ffb060625","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-47f9584a6b23254ffb060625: start","job_status":"start","queue_duration_s":1.38358,"scheduling_latency_s":1.383597} gitlab # [ 279.171401] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"47f9584a6b23254ffb060625","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-47f9584a6b23254ffb060625: done: 0.024414 sec","job_status":"done","queue_duration_s":1.38358,"scheduling_latency_s":1.383597,"redis_calls":10,"redis_duration_s":0.001396,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024414,"completed_at":"2026-08-16T18:00:05.613Z","load_balancing_strategy":"primary","db_duration_s":0.009004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.209776] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"af168a086e46414cf4f3d7a4","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-af168a086e46414cf4f3d7a4: start","job_status":"start","queue_duration_s":1.409119,"scheduling_latency_s":1.409136} gitlab # [ 279.221990] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"af168a086e46414cf4f3d7a4","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-af168a086e46414cf4f3d7a4: done: 0.018668 sec","job_status":"done","queue_duration_s":1.409119,"scheduling_latency_s":1.409136,"redis_calls":10,"redis_duration_s":0.001401,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018668,"completed_at":"2026-08-16T18:00:05.633Z","load_balancing_strategy":"primary","db_duration_s":0.002609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.260186] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e752ac42b1dddcf187ee752","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e752ac42b1dddcf187ee752: start","job_status":"start","queue_duration_s":1.428993,"scheduling_latency_s":1.429011} gitlab # [ 279.272259] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e752ac42b1dddcf187ee752","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e752ac42b1dddcf187ee752: done: 0.018128 sec","job_status":"done","queue_duration_s":1.428993,"scheduling_latency_s":1.429011,"redis_calls":10,"redis_duration_s":0.0013319999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018128,"completed_at":"2026-08-16T18:00:05.652Z","load_balancing_strategy":"primary","db_duration_s":0.00245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.310464] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c94b3cd88d51fafd1fb46047","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c94b3cd88d51fafd1fb46047: start","job_status":"start","queue_duration_s":1.448175,"scheduling_latency_s":1.448191} gitlab # [ 279.322721] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c94b3cd88d51fafd1fb46047","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c94b3cd88d51fafd1fb46047: done: 0.018577 sec","job_status":"done","queue_duration_s":1.448175,"scheduling_latency_s":1.448191,"redis_calls":10,"redis_duration_s":0.001385,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018577,"completed_at":"2026-08-16T18:00:05.672Z","load_balancing_strategy":"primary","db_duration_s":0.002492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.362825] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"33e8df89ceee979b89de8c1e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-33e8df89ceee979b89de8c1e: start","job_status":"start","queue_duration_s":1.467907,"scheduling_latency_s":1.467925} gitlab # [ 279.375211] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"33e8df89ceee979b89de8c1e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-33e8df89ceee979b89de8c1e: done: 0.018592 sec","job_status":"done","queue_duration_s":1.467907,"scheduling_latency_s":1.467925,"redis_calls":10,"redis_duration_s":0.001486,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018592,"completed_at":"2026-08-16T18:00:05.692Z","load_balancing_strategy":"primary","db_duration_s":0.002252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.413624] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0b5c58472f5e79ee62d29744","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0b5c58472f5e79ee62d29744: start","job_status":"start","queue_duration_s":1.48758,"scheduling_latency_s":1.487597} gitlab # [ 279.425669] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0b5c58472f5e79ee62d29744","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0b5c58472f5e79ee62d29744: done: 0.018288 sec","job_status":"done","queue_duration_s":1.48758,"scheduling_latency_s":1.487597,"redis_calls":10,"redis_duration_s":0.001398,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018288,"completed_at":"2026-08-16T18:00:05.711Z","load_balancing_strategy":"primary","db_duration_s":0.002287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.464106] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5ddcd3e9db513129f2c57344","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5ddcd3e9db513129f2c57344: start","job_status":"start","queue_duration_s":1.507045,"scheduling_latency_s":1.507062} gitlab # [ 279.476147] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5ddcd3e9db513129f2c57344","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5ddcd3e9db513129f2c57344: done: 0.017936 sec","job_status":"done","queue_duration_s":1.507045,"scheduling_latency_s":1.507062,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017936,"completed_at":"2026-08-16T18:00:05.730Z","load_balancing_strategy":"primary","db_duration_s":0.002214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.514259] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"84aec4c1ec3ef565a1ac1079","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-84aec4c1ec3ef565a1ac1079: start","job_status":"start","queue_duration_s":1.526136,"scheduling_latency_s":1.526154} gitlab # [ 279.526568] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"84aec4c1ec3ef565a1ac1079","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-84aec4c1ec3ef565a1ac1079: done: 0.018296 sec","job_status":"done","queue_duration_s":1.526136,"scheduling_latency_s":1.526154,"redis_calls":10,"redis_duration_s":0.001424,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018296,"completed_at":"2026-08-16T18:00:05.749Z","load_balancing_strategy":"primary","db_duration_s":0.002217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.566365] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7cef9501d194ef3819dd4721","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7cef9501d194ef3819dd4721: start","job_status":"start","queue_duration_s":1.545604,"scheduling_latency_s":1.545621} gitlab # [ 279.578685] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7cef9501d194ef3819dd4721","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7cef9501d194ef3819dd4721: done: 0.018133 sec","job_status":"done","queue_duration_s":1.545604,"scheduling_latency_s":1.545621,"redis_calls":10,"redis_duration_s":0.001371,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018133,"completed_at":"2026-08-16T18:00:05.769Z","load_balancing_strategy":"primary","db_duration_s":0.002344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.616969] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7709b499bfbc52357226c14a","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7709b499bfbc52357226c14a: start","job_status":"start","queue_duration_s":1.564899,"scheduling_latency_s":1.564916} gitlab # [ 279.629210] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7709b499bfbc52357226c14a","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7709b499bfbc52357226c14a: done: 0.018402 sec","job_status":"done","queue_duration_s":1.564899,"scheduling_latency_s":1.564916,"redis_calls":10,"redis_duration_s":0.001414,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018402,"completed_at":"2026-08-16T18:00:05.788Z","load_balancing_strategy":"primary","db_duration_s":0.002283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.667983] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bda49b43d0ca6ed4f21ab3da","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bda49b43d0ca6ed4f21ab3da: start","job_status":"start","queue_duration_s":1.584451,"scheduling_latency_s":1.584468} gitlab # [ 279.680515] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bda49b43d0ca6ed4f21ab3da","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bda49b43d0ca6ed4f21ab3da: done: 0.018084 sec","job_status":"done","queue_duration_s":1.584451,"scheduling_latency_s":1.584468,"redis_calls":10,"redis_duration_s":0.001362,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018084,"completed_at":"2026-08-16T18:00:05.808Z","load_balancing_strategy":"primary","db_duration_s":0.002176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.719097] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3691dbaaa99882a218a3b95d","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3691dbaaa99882a218a3b95d: start","job_status":"start","queue_duration_s":1.603658,"scheduling_latency_s":1.603674} gitlab # [ 279.731498] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3691dbaaa99882a218a3b95d","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3691dbaaa99882a218a3b95d: done: 0.017956 sec","job_status":"done","queue_duration_s":1.603658,"scheduling_latency_s":1.603674,"redis_calls":10,"redis_duration_s":0.0013540000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000772,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017956,"completed_at":"2026-08-16T18:00:05.827Z","load_balancing_strategy":"primary","db_duration_s":0.002212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.771925] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5e599aa510ab4d9be1903024","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5e599aa510ab4d9be1903024: start","job_status":"start","queue_duration_s":1.622789,"scheduling_latency_s":1.622807} gitlab # [ 279.784431] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5e599aa510ab4d9be1903024","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5e599aa510ab4d9be1903024: done: 0.018097 sec","job_status":"done","queue_duration_s":1.622789,"scheduling_latency_s":1.622807,"redis_calls":10,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000824,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018097,"completed_at":"2026-08-16T18:00:05.846Z","load_balancing_strategy":"primary","db_duration_s":0.00227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.823352] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef0fd3ee7c50df1d1c11c857","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef0fd3ee7c50df1d1c11c857: start","job_status":"start","queue_duration_s":1.641992,"scheduling_latency_s":1.642009} gitlab # [ 279.835857] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef0fd3ee7c50df1d1c11c857","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef0fd3ee7c50df1d1c11c857: done: 0.018338 sec","job_status":"done","queue_duration_s":1.641992,"scheduling_latency_s":1.642009,"redis_calls":10,"redis_duration_s":0.001371,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018338,"completed_at":"2026-08-16T18:00:05.865Z","load_balancing_strategy":"primary","db_duration_s":0.002738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.874340] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08a2d0eafc70c67fb6b54d35","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08a2d0eafc70c67fb6b54d35: start","job_status":"start","queue_duration_s":1.661434,"scheduling_latency_s":1.661451} gitlab # [ 279.886657] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08a2d0eafc70c67fb6b54d35","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08a2d0eafc70c67fb6b54d35: done: 0.018511 sec","job_status":"done","queue_duration_s":1.661434,"scheduling_latency_s":1.661451,"redis_calls":10,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018511,"completed_at":"2026-08-16T18:00:05.885Z","load_balancing_strategy":"primary","db_duration_s":0.002471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.925764] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"736185114566fe6aadeed284","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-736185114566fe6aadeed284: start","job_status":"start","queue_duration_s":1.681136,"scheduling_latency_s":1.681153} gitlab # [ 279.938154] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"736185114566fe6aadeed284","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-736185114566fe6aadeed284: done: 0.01821 sec","job_status":"done","queue_duration_s":1.681136,"scheduling_latency_s":1.681153,"redis_calls":10,"redis_duration_s":0.0013540000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000772,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01821,"completed_at":"2026-08-16T18:00:05.904Z","load_balancing_strategy":"primary","db_duration_s":0.002178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.977689] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b7c1cc2a0b08a7d82f14f34c","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b7c1cc2a0b08a7d82f14f34c: start","job_status":"start","queue_duration_s":1.700428,"scheduling_latency_s":1.700443} gitlab # [ 279.990123] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b7c1cc2a0b08a7d82f14f34c","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b7c1cc2a0b08a7d82f14f34c: done: 0.018068 sec","job_status":"done","queue_duration_s":1.700428,"scheduling_latency_s":1.700443,"redis_calls":10,"redis_duration_s":0.001382,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018068,"completed_at":"2026-08-16T18:00:05.924Z","load_balancing_strategy":"primary","db_duration_s":0.002261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.028484] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0253b5db21ae54ec29f1c3d0","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0253b5db21ae54ec29f1c3d0: start","job_status":"start","queue_duration_s":1.719662,"scheduling_latency_s":1.71968} gitlab # [ 280.040323] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0253b5db21ae54ec29f1c3d0","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0253b5db21ae54ec29f1c3d0: done: 0.017872 sec","job_status":"done","queue_duration_s":1.719662,"scheduling_latency_s":1.71968,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017872,"completed_at":"2026-08-16T18:00:05.943Z","load_balancing_strategy":"primary","db_duration_s":0.002147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.078605] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"06574e6466e8e5352c8d7f3e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-06574e6466e8e5352c8d7f3e: start","job_status":"start","queue_duration_s":1.738654,"scheduling_latency_s":1.738671} gitlab # [ 280.090942] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"06574e6466e8e5352c8d7f3e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-06574e6466e8e5352c8d7f3e: done: 0.017991 sec","job_status":"done","queue_duration_s":1.738654,"scheduling_latency_s":1.738671,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017991,"completed_at":"2026-08-16T18:00:05.962Z","load_balancing_strategy":"primary","db_duration_s":0.002206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.129657] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b407f0c8ed70c392a78511f8","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b407f0c8ed70c392a78511f8: start","job_status":"start","queue_duration_s":1.757849,"scheduling_latency_s":1.757867} gitlab # [ 280.142039] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b407f0c8ed70c392a78511f8","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b407f0c8ed70c392a78511f8: done: 0.018024 sec","job_status":"done","queue_duration_s":1.757849,"scheduling_latency_s":1.757867,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018024,"completed_at":"2026-08-16T18:00:05.981Z","load_balancing_strategy":"primary","db_duration_s":0.002223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.181404] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:05.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"888ed172c64c25abc149c6f2","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-888ed172c64c25abc149c6f2: start","job_status":"start","queue_duration_s":1.777011,"scheduling_latency_s":1.777028} gitlab # [ 280.193623] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"888ed172c64c25abc149c6f2","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-888ed172c64c25abc149c6f2: done: 0.018319 sec","job_status":"done","queue_duration_s":1.777011,"scheduling_latency_s":1.777028,"redis_calls":10,"redis_duration_s":0.00135,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018319,"completed_at":"2026-08-16T18:00:06.000Z","load_balancing_strategy":"primary","db_duration_s":0.002165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.231414] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f0147283429a22073bb48f48","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f0147283429a22073bb48f48: start","job_status":"start","queue_duration_s":1.79642,"scheduling_latency_s":1.796435} gitlab # [ 280.243801] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f0147283429a22073bb48f48","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f0147283429a22073bb48f48: done: 0.01847 sec","job_status":"done","queue_duration_s":1.79642,"scheduling_latency_s":1.796435,"redis_calls":10,"redis_duration_s":0.001435,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01847,"completed_at":"2026-08-16T18:00:06.020Z","load_balancing_strategy":"primary","db_duration_s":0.002304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.282367] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef8b1fce134d99e1a9da217c","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef8b1fce134d99e1a9da217c: start","job_status":"start","queue_duration_s":1.816002,"scheduling_latency_s":1.816018} gitlab # [ 280.294424] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef8b1fce134d99e1a9da217c","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef8b1fce134d99e1a9da217c: done: 0.0179 sec","job_status":"done","queue_duration_s":1.816002,"scheduling_latency_s":1.816018,"redis_calls":10,"redis_duration_s":0.0013319999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0179,"completed_at":"2026-08-16T18:00:06.039Z","load_balancing_strategy":"primary","db_duration_s":0.002338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.332742] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"393cc65228dd0463d75c7a30","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-393cc65228dd0463d75c7a30: start","job_status":"start","queue_duration_s":1.835037,"scheduling_latency_s":1.835054} gitlab # [ 280.344877] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"393cc65228dd0463d75c7a30","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-393cc65228dd0463d75c7a30: done: 0.017788 sec","job_status":"done","queue_duration_s":1.835037,"scheduling_latency_s":1.835054,"redis_calls":10,"redis_duration_s":0.001361,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017788,"completed_at":"2026-08-16T18:00:06.058Z","load_balancing_strategy":"primary","db_duration_s":0.002161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.384275] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5b38008ca31d23a1dad7fb58","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5b38008ca31d23a1dad7fb58: start","job_status":"start","queue_duration_s":1.853977,"scheduling_latency_s":1.853996} gitlab # [ 280.396167] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5b38008ca31d23a1dad7fb58","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5b38008ca31d23a1dad7fb58: done: 0.01819 sec","job_status":"done","queue_duration_s":1.853977,"scheduling_latency_s":1.853996,"redis_calls":10,"redis_duration_s":0.001413,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01819,"completed_at":"2026-08-16T18:00:06.077Z","load_balancing_strategy":"primary","db_duration_s":0.002422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.434353] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fd328bb87d52f6d668db964e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fd328bb87d52f6d668db964e: start","job_status":"start","queue_duration_s":1.873282,"scheduling_latency_s":1.8733} gitlab # [ 280.446609] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fd328bb87d52f6d668db964e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fd328bb87d52f6d668db964e: done: 0.018104 sec","job_status":"done","queue_duration_s":1.873282,"scheduling_latency_s":1.8733,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018104,"completed_at":"2026-08-16T18:00:06.096Z","load_balancing_strategy":"primary","db_duration_s":0.002204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.484725] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ea81ce23c6f507b86972669b","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ea81ce23c6f507b86972669b: start","job_status":"start","queue_duration_s":1.892502,"scheduling_latency_s":1.892519} gitlab # [ 280.496864] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ea81ce23c6f507b86972669b","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ea81ce23c6f507b86972669b: done: 0.018108 sec","job_status":"done","queue_duration_s":1.892502,"scheduling_latency_s":1.892519,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018108,"completed_at":"2026-08-16T18:00:06.116Z","load_balancing_strategy":"primary","db_duration_s":0.00224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.535174] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"98f4fe2784858bdede98fa43","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-98f4fe2784858bdede98fa43: start","job_status":"start","queue_duration_s":1.911722,"scheduling_latency_s":1.911739} gitlab # [ 280.547293] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"98f4fe2784858bdede98fa43","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-98f4fe2784858bdede98fa43: done: 0.017821 sec","job_status":"done","queue_duration_s":1.911722,"scheduling_latency_s":1.911739,"redis_calls":10,"redis_duration_s":0.001351,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017821,"completed_at":"2026-08-16T18:00:06.135Z","load_balancing_strategy":"primary","db_duration_s":0.002169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.587313] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e1bbe1f8fa477f44d428ee2e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e1bbe1f8fa477f44d428ee2e: start","job_status":"start","queue_duration_s":1.930646,"scheduling_latency_s":1.930663} gitlab # [ 280.599638] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e1bbe1f8fa477f44d428ee2e","created_at":"2026-08-16T18:00:04.123Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-c229c099cec644a8","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"039203ea6e508902ad67fd04da6f0ac0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.205Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e1bbe1f8fa477f44d428ee2e: done: 0.017922 sec","job_status":"done","queue_duration_s":1.930646,"scheduling_latency_s":1.930663,"redis_calls":10,"redis_duration_s":0.00135,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017922,"completed_at":"2026-08-16T18:00:06.154Z","load_balancing_strategy":"primary","db_duration_s":0.002211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.638500] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f08c77290b9122533c680df","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f08c77290b9122533c680df: start","job_status":"start","queue_duration_s":1.59977,"scheduling_latency_s":1.599788} gitlab # [ 280.650993] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f08c77290b9122533c680df","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f08c77290b9122533c680df: done: 0.013991 sec","job_status":"done","queue_duration_s":1.59977,"scheduling_latency_s":1.599788,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013991,"completed_at":"2026-08-16T18:00:06.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.690379] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7b2150ec3cd1fa8f21a51cf","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7b2150ec3cd1fa8f21a51cf: start","job_status":"start","queue_duration_s":1.614892,"scheduling_latency_s":1.614908} gitlab # [ 280.702798] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7b2150ec3cd1fa8f21a51cf","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7b2150ec3cd1fa8f21a51cf: done: 0.013745 sec","job_status":"done","queue_duration_s":1.614892,"scheduling_latency_s":1.614908,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013745,"completed_at":"2026-08-16T18:00:06.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.742268] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b95559710373a0e6fc36d19c","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b95559710373a0e6fc36d19c: start","job_status":"start","queue_duration_s":1.629721,"scheduling_latency_s":1.629736} gitlab # [ 280.754674] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b95559710373a0e6fc36d19c","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b95559710373a0e6fc36d19c: done: 0.014357 sec","job_status":"done","queue_duration_s":1.629721,"scheduling_latency_s":1.629736,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014357,"completed_at":"2026-08-16T18:00:06.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.795088] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a472524a1fe3cc89a0179b","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a472524a1fe3cc89a0179b: start","job_status":"start","queue_duration_s":1.645193,"scheduling_latency_s":1.64521} gitlab # [ 280.807731] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a472524a1fe3cc89a0179b","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a472524a1fe3cc89a0179b: done: 0.013638 sec","job_status":"done","queue_duration_s":1.645193,"scheduling_latency_s":1.64521,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013638,"completed_at":"2026-08-16T18:00:06.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.847339] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51a3b8b445ca5b501d121aad","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51a3b8b445ca5b501d121aad: start","job_status":"start","queue_duration_s":1.659949,"scheduling_latency_s":1.659966} gitlab # [ 280.859953] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51a3b8b445ca5b501d121aad","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51a3b8b445ca5b501d121aad: done: 0.013683 sec","job_status":"done","queue_duration_s":1.659949,"scheduling_latency_s":1.659966,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013683,"completed_at":"2026-08-16T18:00:06.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.899183] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"617ecc5e696ef4c5eebaeedc","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-617ecc5e696ef4c5eebaeedc: start","job_status":"start","queue_duration_s":1.674707,"scheduling_latency_s":1.674723} gitlab # [ 280.911810] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"617ecc5e696ef4c5eebaeedc","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-617ecc5e696ef4c5eebaeedc: done: 0.01382 sec","job_status":"done","queue_duration_s":1.674707,"scheduling_latency_s":1.674723,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01382,"completed_at":"2026-08-16T18:00:06.244Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.950969] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6e3eae16e8d6aeb5bea8626","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6e3eae16e8d6aeb5bea8626: start","job_status":"start","queue_duration_s":1.689642,"scheduling_latency_s":1.689658} gitlab # [ 280.964346] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6e3eae16e8d6aeb5bea8626","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6e3eae16e8d6aeb5bea8626: done: 0.013807 sec","job_status":"done","queue_duration_s":1.689642,"scheduling_latency_s":1.689658,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013807,"completed_at":"2026-08-16T18:00:06.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.003175] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5ad38290589ec037539482","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5ad38290589ec037539482: start","job_status":"start","queue_duration_s":1.704553,"scheduling_latency_s":1.704569} gitlab # [ 281.015515] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5ad38290589ec037539482","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5ad38290589ec037539482: done: 0.013557 sec","job_status":"done","queue_duration_s":1.704553,"scheduling_latency_s":1.704569,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013557,"completed_at":"2026-08-16T18:00:06.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.054534] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7968ec6e837adf4fa428fd17","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7968ec6e837adf4fa428fd17: start","job_status":"start","queue_duration_s":1.719238,"scheduling_latency_s":1.719256} gitlab # [ 281.066971] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7968ec6e837adf4fa428fd17","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7968ec6e837adf4fa428fd17: done: 0.013986 sec","job_status":"done","queue_duration_s":1.719238,"scheduling_latency_s":1.719256,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013986,"completed_at":"2026-08-16T18:00:06.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.105761] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a539c5860dc6edfffffc5404","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a539c5860dc6edfffffc5404: start","job_status":"start","queue_duration_s":1.73432,"scheduling_latency_s":1.734336} gitlab # [ 281.118047] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a539c5860dc6edfffffc5404","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a539c5860dc6edfffffc5404: done: 0.014916 sec","job_status":"done","queue_duration_s":1.73432,"scheduling_latency_s":1.734336,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014916,"completed_at":"2026-08-16T18:00:06.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.156895] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e56a5bf0779d4d23249e0e1a","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e56a5bf0779d4d23249e0e1a: start","job_status":"start","queue_duration_s":1.750394,"scheduling_latency_s":1.750411} gitlab # [ 281.170057] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e56a5bf0779d4d23249e0e1a","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e56a5bf0779d4d23249e0e1a: done: 0.013826 sec","job_status":"done","queue_duration_s":1.750394,"scheduling_latency_s":1.750411,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013826,"completed_at":"2026-08-16T18:00:06.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.208863] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99c0882e99cd6a5ed215c8a9","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99c0882e99cd6a5ed215c8a9: start","job_status":"start","queue_duration_s":1.765402,"scheduling_latency_s":1.765418} gitlab # [ 281.221138] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99c0882e99cd6a5ed215c8a9","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99c0882e99cd6a5ed215c8a9: done: 0.014746 sec","job_status":"done","queue_duration_s":1.765402,"scheduling_latency_s":1.765418,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014746,"completed_at":"2026-08-16T18:00:06.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.260261] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc4f5bedd4aa6d6dabc14e13","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc4f5bedd4aa6d6dabc14e13: start","job_status":"start","queue_duration_s":1.781426,"scheduling_latency_s":1.781443} gitlab # [ 281.272951] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc4f5bedd4aa6d6dabc14e13","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc4f5bedd4aa6d6dabc14e13: done: 0.014407 sec","job_status":"done","queue_duration_s":1.781426,"scheduling_latency_s":1.781443,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014407,"completed_at":"2026-08-16T18:00:06.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.312050] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6890f4a534fc3cc5382457a6","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6890f4a534fc3cc5382457a6: start","job_status":"start","queue_duration_s":1.797067,"scheduling_latency_s":1.797083} gitlab # [ 281.324032] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6890f4a534fc3cc5382457a6","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6890f4a534fc3cc5382457a6: done: 0.016226 sec","job_status":"done","queue_duration_s":1.797067,"scheduling_latency_s":1.797083,"redis_calls":13,"redis_duration_s":0.003306,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016226,"completed_at":"2026-08-16T18:00:06.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.362900] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98fa1b93a696a2964a838468","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98fa1b93a696a2964a838468: start","job_status":"start","queue_duration_s":1.814586,"scheduling_latency_s":1.814604} gitlab # [ 281.376361] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98fa1b93a696a2964a838468","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98fa1b93a696a2964a838468: done: 0.014639 sec","job_status":"done","queue_duration_s":1.814586,"scheduling_latency_s":1.814604,"redis_calls":13,"redis_duration_s":0.00173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014639,"completed_at":"2026-08-16T18:00:06.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.415500] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0345d02ed114466c14183446","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0345d02ed114466c14183446: start","job_status":"start","queue_duration_s":1.830323,"scheduling_latency_s":1.830339} gitlab # [ 281.428178] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0345d02ed114466c14183446","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0345d02ed114466c14183446: done: 0.01465 sec","job_status":"done","queue_duration_s":1.830323,"scheduling_latency_s":1.830339,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01465,"completed_at":"2026-08-16T18:00:06.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.467111] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de4485a84dac086c7b6fc142","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de4485a84dac086c7b6fc142: start","job_status":"start","queue_duration_s":1.846056,"scheduling_latency_s":1.846072} gitlab # [ 281.479534] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de4485a84dac086c7b6fc142","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de4485a84dac086c7b6fc142: done: 0.014749 sec","job_status":"done","queue_duration_s":1.846056,"scheduling_latency_s":1.846072,"redis_calls":13,"redis_duration_s":0.0017300000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014749,"completed_at":"2026-08-16T18:00:06.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.518717] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acb7337ec9a0e00b5fc55342","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acb7337ec9a0e00b5fc55342: start","job_status":"start","queue_duration_s":1.861909,"scheduling_latency_s":1.861924} gitlab # [ 281.531258] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acb7337ec9a0e00b5fc55342","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acb7337ec9a0e00b5fc55342: done: 0.015458 sec","job_status":"done","queue_duration_s":1.861909,"scheduling_latency_s":1.861924,"redis_calls":13,"redis_duration_s":0.002312,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015458,"completed_at":"2026-08-16T18:00:06.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.570235] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc02ef49ab442ddf22eb2e3a","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc02ef49ab442ddf22eb2e3a: start","job_status":"start","queue_duration_s":1.87841,"scheduling_latency_s":1.878426} gitlab # [ 281.583698] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc02ef49ab442ddf22eb2e3a","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc02ef49ab442ddf22eb2e3a: done: 0.014571 sec","job_status":"done","queue_duration_s":1.87841,"scheduling_latency_s":1.878426,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014571,"completed_at":"2026-08-16T18:00:06.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.622921] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bac1763eac05b66d427b49bb","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bac1763eac05b66d427b49bb: start","job_status":"start","queue_duration_s":1.894038,"scheduling_latency_s":1.894053} gitlab # [ 281.635193] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bac1763eac05b66d427b49bb","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bac1763eac05b66d427b49bb: done: 0.014548 sec","job_status":"done","queue_duration_s":1.894038,"scheduling_latency_s":1.894053,"redis_calls":13,"redis_duration_s":0.001618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014548,"completed_at":"2026-08-16T18:00:06.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.674424] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd987e2ba69a98deee4458f9","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd987e2ba69a98deee4458f9: start","job_status":"start","queue_duration_s":1.909851,"scheduling_latency_s":1.909868} gitlab # [ 281.686906] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd987e2ba69a98deee4458f9","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd987e2ba69a98deee4458f9: done: 0.014244 sec","job_status":"done","queue_duration_s":1.909851,"scheduling_latency_s":1.909868,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014244,"completed_at":"2026-08-16T18:00:06.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.725980] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"532962c62b4bc5eee140f38c","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-532962c62b4bc5eee140f38c: start","job_status":"start","queue_duration_s":1.92534,"scheduling_latency_s":1.925357} gitlab # [ 281.738159] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"532962c62b4bc5eee140f38c","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-532962c62b4bc5eee140f38c: done: 0.014711 sec","job_status":"done","queue_duration_s":1.92534,"scheduling_latency_s":1.925357,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014711,"completed_at":"2026-08-16T18:00:06.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.778319] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"495b5b15085c10ee574e8634","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-495b5b15085c10ee574e8634: start","job_status":"start","queue_duration_s":1.94134,"scheduling_latency_s":1.941356} gitlab # [ 281.790756] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"495b5b15085c10ee574e8634","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-495b5b15085c10ee574e8634: done: 0.01459 sec","job_status":"done","queue_duration_s":1.94134,"scheduling_latency_s":1.941356,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01459,"completed_at":"2026-08-16T18:00:06.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.829641] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7086dd6832378d8c8185f90","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7086dd6832378d8c8185f90: start","job_status":"start","queue_duration_s":1.957162,"scheduling_latency_s":1.957178} gitlab # [ 281.841836] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7086dd6832378d8c8185f90","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7086dd6832378d8c8185f90: done: 0.014378 sec","job_status":"done","queue_duration_s":1.957162,"scheduling_latency_s":1.957178,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014378,"completed_at":"2026-08-16T18:00:06.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.880906] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cdd86311974859ae37d95c8","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cdd86311974859ae37d95c8: start","job_status":"start","queue_duration_s":1.972848,"scheduling_latency_s":1.972864} gitlab # [ 281.893086] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cdd86311974859ae37d95c8","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cdd86311974859ae37d95c8: done: 0.014671 sec","job_status":"done","queue_duration_s":1.972848,"scheduling_latency_s":1.972864,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014671,"completed_at":"2026-08-16T18:00:06.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.933141] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18e8872e0b9c4c4015edb2db","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18e8872e0b9c4c4015edb2db: start","job_status":"start","queue_duration_s":1.98863,"scheduling_latency_s":1.988647} gitlab # [ 281.945643] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18e8872e0b9c4c4015edb2db","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18e8872e0b9c4c4015edb2db: done: 0.014707 sec","job_status":"done","queue_duration_s":1.98863,"scheduling_latency_s":1.988647,"redis_calls":13,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014707,"completed_at":"2026-08-16T18:00:06.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.986028] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48c44d90d38322961d0ae7da","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48c44d90d38322961d0ae7da: start","job_status":"start","queue_duration_s":2.004421,"scheduling_latency_s":2.004437} gitlab # [ 281.998205] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48c44d90d38322961d0ae7da","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48c44d90d38322961d0ae7da: done: 0.014682 sec","job_status":"done","queue_duration_s":2.004421,"scheduling_latency_s":2.004437,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014682,"completed_at":"2026-08-16T18:00:06.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.037028] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3af949ae6adc1e8e96995a95","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3af949ae6adc1e8e96995a95: start","job_status":"start","queue_duration_s":2.020297,"scheduling_latency_s":2.020313} gitlab # [ 282.049324] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3af949ae6adc1e8e96995a95","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3af949ae6adc1e8e96995a95: done: 0.014702 sec","job_status":"done","queue_duration_s":2.020297,"scheduling_latency_s":2.020313,"redis_calls":13,"redis_duration_s":0.001825,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014702,"completed_at":"2026-08-16T18:00:06.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.088344] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff371fb8c242f8bdcafecc55","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff371fb8c242f8bdcafecc55: start","job_status":"start","queue_duration_s":2.036072,"scheduling_latency_s":2.036088} gitlab # [ 282.100326] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff371fb8c242f8bdcafecc55","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff371fb8c242f8bdcafecc55: done: 0.085715 sec","job_status":"done","queue_duration_s":2.036072,"scheduling_latency_s":2.036088,"redis_calls":13,"redis_duration_s":0.00169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.085715,"completed_at":"2026-08-16T18:00:06.677Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.139103] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d02f70d5905a0f2ed5d27bc","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d02f70d5905a0f2ed5d27bc: start","job_status":"start","queue_duration_s":2.123084,"scheduling_latency_s":2.123103} gitlab # [ 282.151643] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d02f70d5905a0f2ed5d27bc","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d02f70d5905a0f2ed5d27bc: done: 0.014224 sec","job_status":"done","queue_duration_s":2.123084,"scheduling_latency_s":2.123103,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014224,"completed_at":"2026-08-16T18:00:06.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.192139] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a30b6d3075b317302a6b7e9e","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a30b6d3075b317302a6b7e9e: start","job_status":"start","queue_duration_s":2.138325,"scheduling_latency_s":2.138341} gitlab # [ 282.204291] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a30b6d3075b317302a6b7e9e","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a30b6d3075b317302a6b7e9e: done: 0.016397 sec","job_status":"done","queue_duration_s":2.138325,"scheduling_latency_s":2.138341,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016397,"completed_at":"2026-08-16T18:00:06.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.243626] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b3a838fb6a945c8e2edbd60","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b3a838fb6a945c8e2edbd60: start","job_status":"start","queue_duration_s":2.155841,"scheduling_latency_s":2.155857} gitlab # [ 282.256218] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b3a838fb6a945c8e2edbd60","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b3a838fb6a945c8e2edbd60: done: 0.015118 sec","job_status":"done","queue_duration_s":2.155841,"scheduling_latency_s":2.155857,"redis_calls":13,"redis_duration_s":0.002415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015118,"completed_at":"2026-08-16T18:00:06.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.295478] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8836e0ff9a279f0b8a65939","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8836e0ff9a279f0b8a65939: start","job_status":"start","queue_duration_s":2.172007,"scheduling_latency_s":2.172023} gitlab # [ 282.307938] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8836e0ff9a279f0b8a65939","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8836e0ff9a279f0b8a65939: done: 0.014847 sec","job_status":"done","queue_duration_s":2.172007,"scheduling_latency_s":2.172023,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014847,"completed_at":"2026-08-16T18:00:06.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.347265] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06862e1bfd08d794641a860d","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06862e1bfd08d794641a860d: start","job_status":"start","queue_duration_s":2.187961,"scheduling_latency_s":2.187978} gitlab # [ 282.359759] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06862e1bfd08d794641a860d","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06862e1bfd08d794641a860d: done: 0.015791 sec","job_status":"done","queue_duration_s":2.187961,"scheduling_latency_s":2.187978,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015791,"completed_at":"2026-08-16T18:00:06.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.400083] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f433299ea5d7fe77ee4a3fe","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f433299ea5d7fe77ee4a3fe: start","job_status":"start","queue_duration_s":2.204819,"scheduling_latency_s":2.204835} gitlab # [ 282.412104] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f433299ea5d7fe77ee4a3fe","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f433299ea5d7fe77ee4a3fe: done: 0.015019 sec","job_status":"done","queue_duration_s":2.204819,"scheduling_latency_s":2.204835,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015019,"completed_at":"2026-08-16T18:00:06.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.451575] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cfc6bc671ac611c118b455a","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cfc6bc671ac611c118b455a: start","job_status":"start","queue_duration_s":2.220945,"scheduling_latency_s":2.220961} gitlab # [ 282.464566] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cfc6bc671ac611c118b455a","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cfc6bc671ac611c118b455a: done: 0.015261 sec","job_status":"done","queue_duration_s":2.220945,"scheduling_latency_s":2.220961,"redis_calls":14,"redis_duration_s":0.00173,"redis_read_bytes":138,"redis_write_bytes":1218,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000138,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":61,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015261,"completed_at":"2026-08-16T18:00:06.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.504961] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0baa563ebbbdf5090c08d38","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0baa563ebbbdf5090c08d38: start","job_status":"start","queue_duration_s":2.238081,"scheduling_latency_s":2.238097} gitlab # [ 282.517326] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0baa563ebbbdf5090c08d38","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0baa563ebbbdf5090c08d38: done: 0.01639 sec","job_status":"done","queue_duration_s":2.238081,"scheduling_latency_s":2.238097,"redis_calls":16,"redis_duration_s":0.002491,"redis_read_bytes":394,"redis_write_bytes":1363,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000365,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":206,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001574,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01639,"completed_at":"2026-08-16T18:00:06.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.557971] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e983934230e4a4e2819feeca","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e983934230e4a4e2819feeca: start","job_status":"start","queue_duration_s":2.255579,"scheduling_latency_s":2.255595} gitlab # [ 282.570271] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e983934230e4a4e2819feeca","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e983934230e4a4e2819feeca: done: 0.045551 sec","job_status":"done","queue_duration_s":2.255579,"scheduling_latency_s":2.255595,"redis_calls":15,"redis_duration_s":0.002428,"redis_read_bytes":266,"redis_write_bytes":1297,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":140,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045551,"completed_at":"2026-08-16T18:00:06.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.611887] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71a8cef7b6c5ea9ded8ab0ef","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71a8cef7b6c5ea9ded8ab0ef: start","job_status":"start","queue_duration_s":2.302928,"scheduling_latency_s":2.302945} gitlab # [ 282.624257] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71a8cef7b6c5ea9ded8ab0ef","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71a8cef7b6c5ea9ded8ab0ef: done: 0.015412 sec","job_status":"done","queue_duration_s":2.302928,"scheduling_latency_s":2.302945,"redis_calls":13,"redis_duration_s":0.002278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015412,"completed_at":"2026-08-16T18:00:06.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.663239] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0575bd888705ed64d0ddf78","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0575bd888705ed64d0ddf78: start","job_status":"start","queue_duration_s":2.319483,"scheduling_latency_s":2.319499} gitlab # [ 282.675810] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0575bd888705ed64d0ddf78","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0575bd888705ed64d0ddf78: done: 0.014396 sec","job_status":"done","queue_duration_s":2.319483,"scheduling_latency_s":2.319499,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014396,"completed_at":"2026-08-16T18:00:06.889Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.714885] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca45c97e3cdc59068736967","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca45c97e3cdc59068736967: start","job_status":"start","queue_duration_s":2.334959,"scheduling_latency_s":2.334975} gitlab # [ 282.727480] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca45c97e3cdc59068736967","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca45c97e3cdc59068736967: done: 0.01466 sec","job_status":"done","queue_duration_s":2.334959,"scheduling_latency_s":2.334975,"redis_calls":13,"redis_duration_s":0.001704,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01466,"completed_at":"2026-08-16T18:00:06.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.766666] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09e25af0df3c879c7a2fad95","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09e25af0df3c879c7a2fad95: start","job_status":"start","queue_duration_s":2.351265,"scheduling_latency_s":2.351284} gitlab # [ 282.778930] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09e25af0df3c879c7a2fad95","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09e25af0df3c879c7a2fad95: done: 0.014663 sec","job_status":"done","queue_duration_s":2.351265,"scheduling_latency_s":2.351284,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014663,"completed_at":"2026-08-16T18:00:06.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.819885] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2af195f421aa25821cd61966","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2af195f421aa25821cd61966: start","job_status":"start","queue_duration_s":2.366998,"scheduling_latency_s":2.367015} gitlab # [ 282.832453] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2af195f421aa25821cd61966","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2af195f421aa25821cd61966: done: 0.014289 sec","job_status":"done","queue_duration_s":2.366998,"scheduling_latency_s":2.367015,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014289,"completed_at":"2026-08-16T18:00:06.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.871366] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27106f8c360ec62cabde736","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27106f8c360ec62cabde736: start","job_status":"start","queue_duration_s":2.382405,"scheduling_latency_s":2.382421} gitlab # [ 282.883927] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27106f8c360ec62cabde736","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27106f8c360ec62cabde736: done: 0.014361 sec","job_status":"done","queue_duration_s":2.382405,"scheduling_latency_s":2.382421,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014361,"completed_at":"2026-08-16T18:00:06.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.923094] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517678bbef53e2301c8cd1b2","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517678bbef53e2301c8cd1b2: start","job_status":"start","queue_duration_s":2.398443,"scheduling_latency_s":2.398459} gitlab # [ 282.935607] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517678bbef53e2301c8cd1b2","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517678bbef53e2301c8cd1b2: done: 0.014993 sec","job_status":"done","queue_duration_s":2.398443,"scheduling_latency_s":2.398459,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014993,"completed_at":"2026-08-16T18:00:06.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.974938] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f01ea1649bcba6edbe5bb315","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f01ea1649bcba6edbe5bb315: start","job_status":"start","queue_duration_s":2.414509,"scheduling_latency_s":2.414525} gitlab # [ 282.987462] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f01ea1649bcba6edbe5bb315","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f01ea1649bcba6edbe5bb315: done: 0.014623 sec","job_status":"done","queue_duration_s":2.414509,"scheduling_latency_s":2.414525,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014623,"completed_at":"2026-08-16T18:00:06.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.027834] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:06.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62526044c345a67e6358e84e","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62526044c345a67e6358e84e: start","job_status":"start","queue_duration_s":2.431032,"scheduling_latency_s":2.431049} gitlab # [ 283.040540] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62526044c345a67e6358e84e","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62526044c345a67e6358e84e: done: 0.014499 sec","job_status":"done","queue_duration_s":2.431032,"scheduling_latency_s":2.431049,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014499,"completed_at":"2026-08-16T18:00:07.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.079380] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"215067702aeab892fd1b7868","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-215067702aeab892fd1b7868: start","job_status":"start","queue_duration_s":2.446566,"scheduling_latency_s":2.446581} gitlab # [ 283.091646] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"215067702aeab892fd1b7868","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-215067702aeab892fd1b7868: done: 0.014551 sec","job_status":"done","queue_duration_s":2.446566,"scheduling_latency_s":2.446581,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014551,"completed_at":"2026-08-16T18:00:07.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.130771] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dada5869962608e1fdbc70e6","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dada5869962608e1fdbc70e6: start","job_status":"start","queue_duration_s":2.46217,"scheduling_latency_s":2.462185} gitlab # [ 283.143142] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dada5869962608e1fdbc70e6","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dada5869962608e1fdbc70e6: done: 0.043182 sec","job_status":"done","queue_duration_s":2.46217,"scheduling_latency_s":2.462185,"redis_calls":15,"redis_duration_s":0.00387,"redis_read_bytes":266,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":132,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043182,"completed_at":"2026-08-16T18:00:07.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.183404] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d25cf2d976eb7da0707def9f","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d25cf2d976eb7da0707def9f: start","job_status":"start","queue_duration_s":2.509776,"scheduling_latency_s":2.509815} gitlab # [ 283.195993] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d25cf2d976eb7da0707def9f","created_at":"2026-08-16T18:00:04.470Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-39debb30215e40af","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f948b0522601f7a189850b72d6a01aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.555Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d25cf2d976eb7da0707def9f: done: 0.03512 sec","job_status":"done","queue_duration_s":2.509776,"scheduling_latency_s":2.509815,"redis_calls":13,"redis_duration_s":0.0037660000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03512,"completed_at":"2026-08-16T18:00:07.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.236458] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.103Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2fc63ef04045618c832333a1","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2fc63ef04045618c832333a1: start","job_status":"start","queue_duration_s":2.490317,"scheduling_latency_s":2.490354} gitlab # [ 283.248425] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.131Z","message":"No existing merge request to be cleaned up."} gitlab # [ 283.250078] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.148Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2fc63ef04045618c832333a1","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2fc63ef04045618c832333a1: done: 0.045134 sec","job_status":"done","queue_duration_s":2.490317,"scheduling_latency_s":2.490354,"redis_calls":10,"redis_duration_s":0.006059,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00464,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045134,"completed_at":"2026-08-16T18:00:07.148Z","load_balancing_strategy":"primary","db_duration_s":0.004667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.288394] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.150Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0371c4bb427e28c5c9c522d6","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0371c4bb427e28c5c9c522d6: start","job_status":"start","queue_duration_s":2.537741,"scheduling_latency_s":2.53777} gitlab # [ 283.300591] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.170Z","message":"No existing merge request to be cleaned up."} gitlab # [ 283.302232] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.183Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0371c4bb427e28c5c9c522d6","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0371c4bb427e28c5c9c522d6: done: 0.033143 sec","job_status":"done","queue_duration_s":2.537741,"scheduling_latency_s":2.53777,"redis_calls":10,"redis_duration_s":0.003074,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033143,"completed_at":"2026-08-16T18:00:07.183Z","load_balancing_strategy":"primary","db_duration_s":0.002899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.340990] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.186Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e59533974b3ae4c6a69ccf95","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e59533974b3ae4c6a69ccf95: start","job_status":"start","queue_duration_s":2.572922,"scheduling_latency_s":2.572944} gitlab # [ 283.352927] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.202Z","message":"No existing merge request to be cleaned up."} gitlab # [ 283.354644] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.215Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e59533974b3ae4c6a69ccf95","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e59533974b3ae4c6a69ccf95: done: 0.029535 sec","job_status":"done","queue_duration_s":2.572922,"scheduling_latency_s":2.572944,"redis_calls":10,"redis_duration_s":0.0031079999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029535,"completed_at":"2026-08-16T18:00:07.215Z","load_balancing_strategy":"primary","db_duration_s":0.0032,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.393164] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.217Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"818611cfe3b0ef25625f6e74","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-818611cfe3b0ef25625f6e74: start","job_status":"start","queue_duration_s":2.604245,"scheduling_latency_s":2.604266} gitlab # [ 283.405508] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.232Z","message":"No existing merge request to be cleaned up."} gitlab # [ 283.407146] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.242Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"818611cfe3b0ef25625f6e74","created_at":"2026-08-16T18:00:04.603Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-b1e67816301045a4","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9da476fa9d5b530f8b2fdf795c1bb519","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.613Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-818611cfe3b0ef25625f6e74: done: 0.025205 sec","job_status":"done","queue_duration_s":2.604245,"scheduling_latency_s":2.604266,"redis_calls":10,"redis_duration_s":0.002693,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025205,"completed_at":"2026-08-16T18:00:07.242Z","load_balancing_strategy":"primary","db_duration_s":0.002587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.446590] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8efdae93ede3af35464019c4","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8efdae93ede3af35464019c4: start","job_status":"start","queue_duration_s":2.379958,"scheduling_latency_s":2.379977} gitlab # [ 283.460158] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8efdae93ede3af35464019c4","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8efdae93ede3af35464019c4: done: 0.062025 sec","job_status":"done","queue_duration_s":2.379958,"scheduling_latency_s":2.379977,"redis_calls":16,"redis_duration_s":0.005391,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000647,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003384,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058384,"duration_s":0.062025,"completed_at":"2026-08-16T18:00:07.307Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.501276] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"792c96279bdfcb44cb4ac3a4","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-792c96279bdfcb44cb4ac3a4: start","job_status":"start","queue_duration_s":2.443768,"scheduling_latency_s":2.443788} gitlab # [ 283.514565] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"792c96279bdfcb44cb4ac3a4","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-792c96279bdfcb44cb4ac3a4: done: 0.021669 sec","job_status":"done","queue_duration_s":2.443768,"scheduling_latency_s":2.443788,"redis_calls":13,"redis_duration_s":0.0035259999999999996,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021669,"completed_at":"2026-08-16T18:00:07.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.554056] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"22f28531ff167579354ac0c1","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-22f28531ff167579354ac0c1: start","job_status":"start","queue_duration_s":2.467025,"scheduling_latency_s":2.467043} gitlab # [ 283.567057] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"22f28531ff167579354ac0c1","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-22f28531ff167579354ac0c1: done: 0.019746 sec","job_status":"done","queue_duration_s":2.467025,"scheduling_latency_s":2.467043,"redis_calls":13,"redis_duration_s":0.0031720000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002158,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019746,"completed_at":"2026-08-16T18:00:07.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.606628] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c7e1718073b27ef3a3bad5a5","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c7e1718073b27ef3a3bad5a5: start","job_status":"start","queue_duration_s":2.488297,"scheduling_latency_s":2.488314} gitlab # [ 283.621050] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c7e1718073b27ef3a3bad5a5","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c7e1718073b27ef3a3bad5a5: done: 0.018965 sec","job_status":"done","queue_duration_s":2.488297,"scheduling_latency_s":2.488314,"redis_calls":13,"redis_duration_s":0.003075,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018965,"completed_at":"2026-08-16T18:00:07.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.660355] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"11f92e0c43b33f49586ba853","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-11f92e0c43b33f49586ba853: start","job_status":"start","queue_duration_s":2.509304,"scheduling_latency_s":2.509321} gitlab # [ 283.673638] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"11f92e0c43b33f49586ba853","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-11f92e0c43b33f49586ba853: done: 0.018381 sec","job_status":"done","queue_duration_s":2.509304,"scheduling_latency_s":2.509321,"redis_calls":13,"redis_duration_s":0.0030359999999999996,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018381,"completed_at":"2026-08-16T18:00:07.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.713248] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"64e5ef67517aa534f1cb8d39","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-64e5ef67517aa534f1cb8d39: start","job_status":"start","queue_duration_s":2.529071,"scheduling_latency_s":2.529086} gitlab # [ 283.726612] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"64e5ef67517aa534f1cb8d39","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-64e5ef67517aa534f1cb8d39: done: 0.019541 sec","job_status":"done","queue_duration_s":2.529071,"scheduling_latency_s":2.529086,"redis_calls":13,"redis_duration_s":0.0038529999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002315,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019541,"completed_at":"2026-08-16T18:00:07.414Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.766177] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"181b3b23f01ed0a33dea38b6","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-181b3b23f01ed0a33dea38b6: start","job_status":"start","queue_duration_s":2.550073,"scheduling_latency_s":2.550089} gitlab # [ 283.779604] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"181b3b23f01ed0a33dea38b6","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-181b3b23f01ed0a33dea38b6: done: 0.016878 sec","job_status":"done","queue_duration_s":2.550073,"scheduling_latency_s":2.550089,"redis_calls":13,"redis_duration_s":0.00302,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016878,"completed_at":"2026-08-16T18:00:07.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.819295] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2061ab777a6b58146eb4fda5","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2061ab777a6b58146eb4fda5: start","job_status":"start","queue_duration_s":2.568313,"scheduling_latency_s":2.568329} gitlab # [ 283.833466] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2061ab777a6b58146eb4fda5","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2061ab777a6b58146eb4fda5: done: 0.017416 sec","job_status":"done","queue_duration_s":2.568313,"scheduling_latency_s":2.568329,"redis_calls":13,"redis_duration_s":0.0030930000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017416,"completed_at":"2026-08-16T18:00:07.451Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.872997] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2fe024ad46fbfe4ae6ead628","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2fe024ad46fbfe4ae6ead628: start","job_status":"start","queue_duration_s":2.587111,"scheduling_latency_s":2.587126} gitlab # [ 283.886269] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2fe024ad46fbfe4ae6ead628","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2fe024ad46fbfe4ae6ead628: done: 0.016738 sec","job_status":"done","queue_duration_s":2.587111,"scheduling_latency_s":2.587126,"redis_calls":13,"redis_duration_s":0.003002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016738,"completed_at":"2026-08-16T18:00:07.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.925534] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"86999f3e6b75c9efe40e9d4e","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-86999f3e6b75c9efe40e9d4e: start","job_status":"start","queue_duration_s":2.6055,"scheduling_latency_s":2.605517} gitlab # [ 283.938899] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:07.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"86999f3e6b75c9efe40e9d4e","created_at":"2026-08-16T18:00:04.845Z","trace_propagation_headers":{"sentry-trace":"d224c6389f6946fcbc026c93aa03ef69-0e396c7fb0494704","baggage":"sentry-trace_id=d224c6389f6946fcbc026c93aa03ef69,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"6ceeb12aa92f9c839ce5dc03d5956281","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:04.865Z","job_size_bytes":2,"pid":2014,"sidekiq_tid":"mapi","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-86999f3e6b75c9efe40e9d4e: done: 0.017911 sec","job_status":"done","queue_duration_s":2.6055,"scheduling_latency_s":2.605517,"redis_calls":13,"redis_duration_s":0.003419,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002422,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017911,"completed_at":"2026-08-16T18:00:07.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.728226] postgres[3257]: [3257] ERROR: relation "table_without_models" does not exist gitlab # [ 308.734435] postgres[3257]: [3257] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 309.145295] redis[787]: 10 changes in 300 seconds. Saving... gitlab # [ 309.152931] redis[787]: Background saving started by pid 3282 gitlab # [ 309.162062] redis[3282]: BGSAVE done, 589 keys saved, 0 keys skipped, 144144 bytes written. gitlab # [ 309.166750] redis[3282]: DB saved on disk gitlab # [ 309.169117] redis[3282]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.253943] redis[787]: Background saving terminated with success gitlab # [ 310.531623] postgres[861]: [861] LOG: checkpoint starting: time gitlab # [ 311.640875] gitaly[893]: time="2026-08-16T18:00:39.505Z" level=info msg="burden monitor stats" pid=893 gitlab # [ 314.567936] runuser[2924]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 314.569870] setup-gitlab-start[2898]: + systemctl restart gitlab-sidekiq.service gitlab # [ 314.601116] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 314.602470] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:42.467Z","message":"Shutting down"} gitlab # [ 314.603968] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:42.467Z","message":"Scheduler exiting..."} gitlab # [ 314.605670] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:42.467Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 314.607462] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:42.468Z","message":"Scheduler exiting..."} gitlab # [ 315.107427] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:42.973Z","message":"Bye!"} gitlab # [ 316.163902] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-16T18:00:44.028Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2014,"worker_id":"sidekiq_0","memwd_rss_bytes":932311040,"retry":0} gitlab # [ 317.733062] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 317.733459] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 317.733671] systemd[1]: gitlab-sidekiq.service: Consumed 1min 50.067s CPU time over 3min 15.251s wall clock time, 937.2M memory peak, 4.6M read from disk. gitlab # [ 317.747213] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 317.753448] setup-gitlab-start[2898]: + mkdir -p /var/lib/secrets gitlab # [ 317.758115] setup-gitlab-start[2898]: + echo nixbot-test-token-of-20-chars gitlab # [ 317.761301] setup-gitlab-start[2898]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 317.764321] setup-gitlab-start[2898]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 319.298690] gitaly[893]: time="2026-08-16T18:00:47.163Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.163" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.329229] gitaly[893]: time="2026-08-16T18:00:47.164Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.163" grpc.time_ms=0.862 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.587563] gitaly[893]: time="2026-08-16T18:00:47.453Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.292" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.453" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.624685] gitaly[893]: time="2026-08-16T18:00:47.453Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.292" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.453" grpc.time_ms=0.614 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.673572] gitaly[893]: time="2026-08-16T18:00:47.539Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D diskcache=6e6014ff-1417-4d2e-b585-61f8b63c2886 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T18:00:57.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.467" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.699892] gitaly[893]: time="2026-08-16T18:00:47.540Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=47 command.spawn_token_fork_ms=7 command.system_time_ms=36 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T18:00:57.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.467" grpc.time_ms=71.916 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.724654] gitaly[893]: time="2026-08-16T18:00:47.590Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.127" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.589" pid=893 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 319.739844] gitaly[893]: time="2026-08-16T18:00:47.591Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.127" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.589" grpc.time_ms=1.938 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.755585] gitaly[893]: time="2026-08-16T18:00:47.619Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:00:57.141" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.601" grpc.time_ms=17.194 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.886531] gitaly[893]: time="2026-08-16T18:00:47.752Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.752" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.918343] gitaly[893]: time="2026-08-16T18:00:47.752Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.752" grpc.time_ms=0.527 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.950967] gitaly[893]: time="2026-08-16T18:00:47.815Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D diskcache=ad9086c2-5f71-4ab8-ba05-def5c73a4175 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T18:00:57.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.757" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.979747] gitaly[893]: time="2026-08-16T18:00:47.815Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=39 command.spawn_token_fork_ms=2 command.system_time_ms=35 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T18:00:57.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.757" grpc.time_ms=57.944 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.004600] gitaly[893]: time="2026-08-16T18:00:47.828Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.076" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.827" pid=893 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 320.019491] gitaly[893]: time="2026-08-16T18:00:47.829Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.076" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.827" grpc.time_ms=1.379 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.033929] gitaly[893]: time="2026-08-16T18:00:47.853Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:00:57.086" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.837" grpc.time_ms=15.885 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.051298] gitaly[893]: time="2026-08-16T18:00:47.910Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:00:57.158" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.909" grpc.time_ms=0.444 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.064954] gitaly[893]: time="2026-08-16T18:00:47.926Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T18:00:57.175" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:47.925" grpc.time_ms=0.582 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.839298] gitaly[893]: time="2026-08-16T18:00:48.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQCTSFXQE9TAS2AJG085D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:00:58.226" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:48.687" grpc.time_ms=16.641 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 321.508334] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:49 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 3715 gitlab # [ 321.513378] setup-gitlab-start[2898]: + mkdir -p /tmp/test-flake gitlab # [ 321.517412] setup-gitlab-start[2898]: + cd /tmp/test-flake gitlab # [ 321.519842] setup-gitlab-start[2898]: + git init -b master gitlab # [ 321.540210] setup-gitlab-start[3375]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 321.543860] setup-gitlab-start[2898]: + git config user.name test gitlab # [ 321.546632] setup-gitlab-start[2898]: + git config user.email test@example.com gitlab # [ 321.550955] setup-gitlab-start[2898]: + cat gitlab # [ 321.555209] setup-gitlab-start[2898]: + git add flake.nix gitlab # [ 321.561636] setup-gitlab-start[2898]: + git commit -m 'initial commit' gitlab # [ 321.588430] setup-gitlab-start[3380]: [master (root-commit) a623a27] initial commit gitlab # [ 321.591131] setup-gitlab-start[3380]: 1 file changed, 10 insertions(+) gitlab # [ 321.594099] setup-gitlab-start[3380]: create mode 100644 flake.nix gitlab # [ 321.597101] setup-gitlab-start[2898]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 321.601097] setup-gitlab-start[2898]: + git push -u origin master gitlab # [ 321.859166] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 218 gitlab # [ 322.013277] gitaly[893]: time="2026-08-16T18:00:49.878Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGSYZZGTF5K3D0A1W6C7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:49.860" grpc.time_ms=17.864 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.053075] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 152 gitlab # [ 322.601698] gitaly[893]: time="2026-08-16T18:00:50.467Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:01:00.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:50.451" grpc.time_ms=16.052 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.641879] sidekiq-cluster[3323]: {"severity":"INFO","time":"2026-08-16T18:00:50.470Z","message":"Starting cluster with 1 processes"} gitlab # [ 322.692854] gitaly[893]: time="2026-08-16T18:00:50.558Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T18:01:20.045" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T18:00:50.545" grpc.time_ms=13.154 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.793817] gitaly[893]: time="2026-08-16T18:00:50.659Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E duration_ms=571ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 322.855827] gitaly[893]: time="2026-08-16T18:00:50.721Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E duration_ms=61ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 322.865112] gitaly[893]: time="2026-08-16T18:00:50.722Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:50.086" grpc.time_ms=636.166 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.909371] gitaly[893]: time="2026-08-16T18:00:50.775Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:50.774" grpc.time_ms=1.298 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.994092] gitaly[893]: time="2026-08-16T18:00:50.860Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:50.858" grpc.time_ms=1.127 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 323.041857] gitaly[893]: time="2026-08-16T18:00:50.906Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:50.906" grpc.time_ms=0.69 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 323.295893] gitaly[893]: time="2026-08-16T18:00:51.161Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:01:01.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:51.144" grpc.time_ms=17.312 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.347743] gitaly[893]: time="2026-08-16T18:00:51.213Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T18:01:01.039" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:00:51.180" grpc.time_ms=32.772 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.387181] gitaly[893]: time="2026-08-16T18:00:51.233Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E duration_ms=277ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 323.395185] gitaly[893]: time="2026-08-16T18:00:51.234Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:50.954" grpc.time_ms=279.858 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 323.419917] gitaly[893]: time="2026-08-16T18:00:51.256Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E diskcache=101a67a7-8ccf-4e39-9660-275e882a4393 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:49.980" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 323.440502] systemd[1]: Finished setup-gitlab.service. gitlab # [ 323.442524] gitlab-workhorse[819]: time="2026-08-16T18:00:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 323.446221] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:51 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1362 gitlab # [ 323.450184] setup-gitlab-start[3384]: To http://gitlab/root/test-flake.git gitlab # [ 323.451931] setup-gitlab-start[3384]: * [new branch] master -> master gitlab # [ 323.453755] setup-gitlab-start[3384]: branch 'master' set up to track 'origin/master'. gitlab # [ 323.455586] gitaly[893]: time="2026-08-16T18:00:51.257Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=322 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=12973 command.oublock=32 command.real_time_ms=1260 command.spawn_token_fork_ms=1 command.system_time_ms=190 command.user_time_ms=132 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:49.980" grpc.time_ms=1276.897 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 323.476888] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 324.49 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 324.714225] nixbot[3477]: {"ts": "2026-08-16T18:00:52.579Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 324.761270] nixbot[3477]: {"ts": "2026-08-16T18:00:52.627Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 324.799644] nixbot[3477]: {"ts": "2026-08-16T18:00:52.665Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 324.806610] nixbot[3477]: {"ts": "2026-08-16T18:00:52.672Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 324.813383] nixbot[3477]: {"ts": "2026-08-16T18:00:52.678Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 324.821670] nixbot[3477]: {"ts": "2026-08-16T18:00:52.687Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 324.828193] nixbot[3477]: {"ts": "2026-08-16T18:00:52.693Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 324.835113] nixbot[3477]: {"ts": "2026-08-16T18:00:52.696Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 324.841700] nixbot[3477]: {"ts": "2026-08-16T18:00:52.705Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 324.848436] nixbot[3477]: {"ts": "2026-08-16T18:00:52.709Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 324.855195] nixbot[3477]: {"ts": "2026-08-16T18:00:52.718Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 324.864328] nixbot[3477]: {"ts": "2026-08-16T18:00:52.730Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 324.870677] nixbot[3477]: {"ts": "2026-08-16T18:00:52.735Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 324.876791] nixbot[3477]: {"ts": "2026-08-16T18:00:52.739Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 324.883104] nixbot[3477]: {"ts": "2026-08-16T18:00:52.746Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 324.889504] nixbot[3477]: {"ts": "2026-08-16T18:00:52.749Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 324.895225] nixbot[3477]: {"ts": "2026-08-16T18:00:52.752Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 324.900598] nixbot[3477]: {"ts": "2026-08-16T18:00:52.754Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 324.905574] nixbot[3477]: {"ts": "2026-08-16T18:00:52.764Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 324.910475] nixbot[3477]: {"ts": "2026-08-16T18:00:52.768Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 324.915518] nixbot[3477]: {"ts": "2026-08-16T18:00:52.771Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 324.920312] nixbot[3477]: {"ts": "2026-08-16T18:00:52.781Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 324.925100] nixbot[3477]: {"ts": "2026-08-16T18:00:52.785Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 324.929764] nixbot[3477]: {"ts": "2026-08-16T18:00:52.788Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 324.934192] nixbot[3477]: {"ts": "2026-08-16T18:00:52.791Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 325.381422] nixbot[3477]: INFO: Started server process [3477] gitlab # [ 325.384263] nixbot[3477]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 325.400169] nixbot[3477]: INFO: ::ffff:127.0.0.1:59956 - "GET /health HTTP/1.1" 200 OK gitlab # [ 325.407641] systemd[1]: Started nixbot CI service. gitlab # [ 325.413169] systemd[1]: Reached target Multi-User System. gitlab # [ 325.416926] systemd[1]: Startup finished in 775ms (kernel) + 4.162s (initrd) + 5min 20.478s (userspace) = 5min 25.415s. gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 326.247491] nixbot[3477]: INFO: ::ffff:127.0.0.1:59960 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 326.415813] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 112 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds) gitlab # [ 326.657987] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:54 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1257 gitlab # [ 326.665471] nixbot[3477]: {"ts": "2026-08-16T18:00:54.525Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 326.696905] nixbot[3477]: {"ts": "2026-08-16T18:00:54.562Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 326.801723] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 96 gitlab # [ 326.816352] nixbot[3477]: {"ts": "2026-08-16T18:00:54.675Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 326.825058] nixbot[3477]: {"ts": "2026-08-16T18:00:54.679Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 327.082931] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 257 gitlab # [ 327.095151] nixbot[3477]: {"ts": "2026-08-16T18:00:54.957Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 327.378168] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 271 gitlab # [ 327.382353] nixbot[3477]: {"ts": "2026-08-16T18:00:55.245Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 327.572777] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 108 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds) (finished: subtest: project discovered and webhook registered, in 1.32 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 327.605488] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 209 gitlab # [ 327.609458] nixbot[3477]: {"ts": "2026-08-16T18:00:55.472Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 327.690203] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 45 gitlab # [ 327.746393] nixbot[3477]: {"ts": "2026-08-16T18:00:55.612Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 327.753112] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 137 gitlab # [ 327.792034] gitaly[893]: time="2026-08-16T18:00:55.657Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPG5C559T0VHRG5RWVTB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:55.645" grpc.time_ms=11.984 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Enumerating objects: 5, done. gitlab # [ 327.814022] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 102 gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 327.902932] gitaly[893]: time="2026-08-16T18:00:55.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=7 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPJBFKP19NGXPE8T41A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T18:01:25.241" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:00:55.742" grpc.time_ms=26.265 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.937075] gitaly[893]: time="2026-08-16T18:00:55.792Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPJBFKP19NGXPE8T41A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:01:25.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:00:55.791" grpc.time_ms=0.974 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.958935] gitaly[893]: time="2026-08-16T18:00:55.805Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPJBFKP19NGXPE8T41A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T18:01:05.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:00:55.796" grpc.time_ms=9.695 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.977981] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 202 gitlab # [ 327.980349] nixbot[3477]: {"ts": "2026-08-16T18:00:55.831Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 328.070543] nixbot[3477]: {"ts": "2026-08-16T18:00:55.936Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 328.073749] nixbot[3477]: {"ts": "2026-08-16T18:00:55.939Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 328.077239] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 108 gitlab # [ 328.099457] gitaly[893]: time="2026-08-16T18:00:55.965Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T18:01:25.449" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T18:00:55.949" grpc.time_ms=15.827 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.122973] gitaly[893]: time="2026-08-16T18:00:55.988Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 duration_ms=122ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 328.164661] gitaly[893]: time="2026-08-16T18:00:56.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPX2G6NQDPZ60XHJRY6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.018" grpc.time_ms=12.385 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.186405] gitaly[893]: time="2026-08-16T18:00:56.033Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 duration_ms=44ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 328.190848] gitaly[893]: time="2026-08-16T18:00:56.033Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:55.865" grpc.time_ms=167.639 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 328.202940] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 60 gitlab # [ 328.218769] gitaly[893]: time="2026-08-16T18:00:56.084Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:56.084" grpc.time_ms=0.658 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 328.258243] gitaly[893]: time="2026-08-16T18:00:56.124Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:56.123" grpc.time_ms=1.205 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 328.271678] gitaly[893]: time="2026-08-16T18:00:56.136Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPZ30SH0M9180J55T8FW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.127" pid=893 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 328.285509] gitlab-workhorse[819]: time="2026-08-16T18:00:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 328.287838] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 102 gitlab # [ 328.290339] gitaly[893]: time="2026-08-16T18:00:56.137Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPZ30SH0M9180J55T8FW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.127" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.305474] gitaly[893]: time="2026-08-16T18:00:56.146Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPZ30SH0M9180J55T8FW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.127" grpc.time_ms=9.682 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.320475] gitaly[893]: time="2026-08-16T18:00:56.183Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:56.181" grpc.time_ms=0.912 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 328.360093] gitaly[893]: time="2026-08-16T18:00:56.225Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQ2C4JKAM3ST3VPCAV8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.209" pid=893 remote_ip="2001:db8:1::1" request_sha=41f0dbba82689251651bfd823056215581f733ca response_bytes=223 span.kind=server system=grpc gitlab # [ 328.370768] gitaly[893]: time="2026-08-16T18:00:56.226Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQ2C4JKAM3ST3VPCAV8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.209" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.384913] gitlab-workhorse[819]: time="2026-08-16T18:00:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 328.386919] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 85 gitlab # [ 328.389303] gitaly[893]: time="2026-08-16T18:00:56.226Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQ2C4JKAM3ST3VPCAV8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.209" grpc.time_ms=16.784 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.416339] gitaly[893]: time="2026-08-16T18:00:56.282Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 duration_ms=68ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 328.419301] gitaly[893]: time="2026-08-16T18:00:56.282Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:56.213" grpc.time_ms=69.689 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 328.433046] gitaly[893]: time="2026-08-16T18:00:56.299Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 diskcache=3ef8a3fc-fa0d-434d-aba2-69e9ee6e842d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:55.764" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 328.443470] gitaly[893]: time="2026-08-16T18:00:56.299Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=202 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13301 command.oublock=32 command.real_time_ms=522 command.spawn_token_fork_ms=1 command.system_time_ms=115 command.user_time_ms=87 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:55.764" grpc.time_ms=535.361 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # a623a27..6908e42 [ 328.457158] gitlab-workhorse[819]: time="2026-08-16T18:00:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 328.459103] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 605 gitlab # gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.90 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 328.510636] gitaly[893]: time="2026-08-16T18:00:56.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05VQQ7QSA2NBB03ETRMZR32 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.369" grpc.time_ms=7.11 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.524261] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # [ 328.583293] gitaly[893]: time="2026-08-16T18:00:56.449Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQ9V9GVTBGK0AXVW3CYK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.436" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.11 seconds) gitlab # [ 328.594333] gitaly[893]: time="2026-08-16T18:00:56.449Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQ9V9GVTBGK0AXVW3CYK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.436" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.608425] gitlab-workhorse[819]: time="2026-08-16T18:00:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 328.610321] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 71 gitlab # [ 328.612515] nixbot[3477]: INFO: ::ffff:127.0.0.1:59974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 328.614419] gitaly[893]: time="2026-08-16T18:00:56.449Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQ9V9GVTBGK0AXVW3CYK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.436" grpc.time_ms=13.209 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.879904] gitaly[893]: time="2026-08-16T18:00:56.744Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQC5QRGN7C4648BP85K5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.709" pid=893 remote_ip="2001:db8:1::1" request_sha=d83da4e7a49c5003220aae720c2c7e1345ca2cd1 response_bytes=337 span.kind=server system=grpc gitlab # [ 328.909497] gitaly[893]: time="2026-08-16T18:00:56.745Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=30 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQC5QRGN7C4648BP85K5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.709" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.938078] gitlab-workhorse[819]: time="2026-08-16T18:00:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 328.942517] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 293 gitlab # [ 328.947037] gitaly[893]: time="2026-08-16T18:00:56.745Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=30 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQC5QRGN7C4648BP85K5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.709" grpc.time_ms=35.409 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 329.111054] gitaly[893]: time="2026-08-16T18:00:56.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05VQQSCTTK1VZJZ336A3JPS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:56.958" grpc.time_ms=18.208 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 329.147874] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 100 gitlab # [ 329.215071] gitaly[893]: time="2026-08-16T18:00:57.081Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQWM7D2BGVRV9XZVWQ0N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:57.048" pid=893 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 329.247553] gitaly[893]: time="2026-08-16T18:00:57.081Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQWM7D2BGVRV9XZVWQ0N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:57.048" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 329.278282] gitlab-workhorse[819]: time="2026-08-16T18:00:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 329.282007] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 101 gitlab # [ 329.285765] gitaly[893]: time="2026-08-16T18:00:57.082Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQQWM7D2BGVRV9XZVWQ0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:00:57.048" grpc.time_ms=32.943 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 329.376404] gitaly[893]: time="2026-08-16T18:00:57.242Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:01:27.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:00:57.240" grpc.time_ms=1.287 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.477451] gitaly[893]: time="2026-08-16T18:00:57.343Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T18:01:27.123" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:00:57.324" grpc.time_ms=18.9 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.528193] gitaly[893]: time="2026-08-16T18:00:57.393Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:01:07.233" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:00:57.373" grpc.time_ms=19.879 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 329.580475] gitaly[893]: time="2026-08-16T18:00:57.446Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:01:07.288" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:00:57.429" grpc.time_ms=17.034 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 329.662504] nixbot[3477]: INFO: ::ffff:127.0.0.1:59988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 329.755044] gitaly[893]: time="2026-08-16T18:00:57.620Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T18:01:07.169" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:57.620" grpc.time_ms=0.603 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.788848] gitaly[893]: time="2026-08-16T18:00:57.654Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T18:01:07.187" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:00:57.637" grpc.time_ms=16.758 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.867764] gitaly[893]: time="2026-08-16T18:00:57.733Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:57.732" grpc.time_ms=0.778 pid=893 span.kind=server system=grpc gitlab # [ 329.919588] gitaly[893]: time="2026-08-16T18:00:57.784Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:00:57.783" grpc.time_ms=1.229 pid=893 span.kind=server system=grpc gitlab # [ 329.943250] gitaly[893]: time="2026-08-16T18:00:57.809Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 diskcache=723c252b-ec8c-42d9-be2a-3f1a31d06edb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T18:01:07.209" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:57.660" pid=893 ref=refs/keep-around/a623a273f2968e5a001506d6f5348a90c585e710 remote_ip="2001:db8:1::1" revision=a623a273f2968e5a001506d6f5348a90c585e710 span.kind=server system=grpc username=root gitlab # [ 329.967667] gitaly[893]: time="2026-08-16T18:00:57.809Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5400 command.oublock=8 command.real_time_ms=134 command.spawn_token_fork_ms=3 command.system_time_ms=92 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T18:01:07.209" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:00:57.660" grpc.time_ms=149.207 pid=893 ref=refs/keep-around/a623a273f2968e5a001506d6f5348a90c585e710 remote_ip="2001:db8:1::1" revision=a623a273f2968e5a001506d6f5348a90c585e710 span.kind=server system=grpc username=root gitlab # [ 329.992605] gitaly[893]: time="2026-08-16T18:00:57.817Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:01:27.315" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:00:57.816" grpc.time_ms=0.77 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 330.253373] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:00:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 973 gitlab # [ 330.261636] nixbot[3477]: {"ts": "2026-08-16T18:00:58.119Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 330.270424] nixbot[3477]: {"ts": "2026-08-16T18:00:58.131Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a623a273f296-0"} gitlab # [ 330.380980] systemd[1]: Started Nix Daemon. gitlab # [ 330.502334] nix-daemon[3692]: accepted connection from pid 3686, user nixbot gitlab # [ 330.632051] nix-daemon[3692]: accepted connection from pid 3700, user nixbot gitlab # [ 330.656957] nixbot[3477]: {"ts": "2026-08-16T18:00:58.522Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a623a273f296-0", "argv0": "bwrap"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 330.712535] nixbot[3477]: INFO: ::ffff:127.0.0.1:59992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 330.878745] nix-daemon[3692]: accepted connection from pid 3713, user nixbot gitlab # [ 330.960963] nix-daemon[3692]: accepted connection from pid 3723, user nixbot gitlab # [ 330.977294] nix-daemon[3692]: accepted connection from pid 3713, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 331.767532] nixbot[3477]: INFO: ::ffff:127.0.0.1:58926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 332.822833] nixbot[3477]: INFO: ::ffff:127.0.0.1:58940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 333.877471] nixbot[3477]: INFO: ::ffff:127.0.0.1:58942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 334.929686] nixbot[3477]: INFO: ::ffff:127.0.0.1:58958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 335.840611] gitaly[893]: time="2026-08-16T18:01:03.705Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQYBFG3AKKAK7RBTM5GDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:01:33.203" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:01:03.704" grpc.time_ms=1.068 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 335.901620] gitaly[893]: time="2026-08-16T18:01:03.767Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQYBFG3AKKAK7RBTM5GDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:01:13.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:01:03.750" grpc.time_ms=17.245 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.989740] nixbot[3477]: INFO: ::ffff:127.0.0.1:58960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 336.048806] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:01:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 313 gitlab # [ 336.056759] nixbot[3477]: {"ts": "2026-08-16T18:01:03.916Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 336.152837] gitaly[893]: time="2026-08-16T18:01:04.018Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQYNMRTP4JC5M9DRRP3E9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:01:34.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:01:04.017" grpc.time_ms=0.967 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.207582] gitaly[893]: time="2026-08-16T18:01:04.073Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M05VQYNMRTP4JC5M9DRRP3E9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:01:14.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:01:04.059" grpc.time_ms=13.801 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.285366] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:01:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 226 gitlab # [ 336.293483] nixbot[3477]: {"ts": "2026-08-16T18:01:04.152Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 336.386219] gitaly[893]: time="2026-08-16T18:01:04.252Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQYX7RMP694E9ENG0SXMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:01:34.050" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:01:04.251" grpc.time_ms=0.939 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.617511] gitaly[893]: time="2026-08-16T18:01:04.483Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQYX7RMP694E9ENG0SXMF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:01:14.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:01:04.465" grpc.time_ms=17.727 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.849342] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:01:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 547 gitlab # [ 336.857376] nixbot[3477]: {"ts": "2026-08-16T18:01:04.717Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 336.993666] nix-daemon[3692]: accepted connection from pid 3761, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 337.046143] nixbot[3477]: INFO: ::ffff:127.0.0.1:58976 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 337.196950] gitaly[893]: time="2026-08-16T18:01:05.061Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQZNP6VGR2R3Y8FYMJ7HH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:01:05.047" grpc.time_ms=13.99 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.237877] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:01:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 152 gitlab # [ 337.362609] gitaly[893]: time="2026-08-16T18:01:05.228Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQZTH1WEEXBRRTFNA8Y3V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:01:05.209" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 337.397031] gitaly[893]: time="2026-08-16T18:01:05.228Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQZTH1WEEXBRRTFNA8Y3V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:01:05.209" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.429302] gitlab-workhorse[819]: time="2026-08-16T18:01:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 337.432670] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:01:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 156 gitlab # [ 337.435896] gitaly[893]: time="2026-08-16T18:01:05.229Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQZTH1WEEXBRRTFNA8Y3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:01:05.209" grpc.time_ms=20.015 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.558757] nix-daemon[3692]: accepted connection from pid 3793, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 338.101318] nixbot[3477]: INFO: ::ffff:127.0.0.1:58990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 339.154218] nixbot[3477]: INFO: ::ffff:127.0.0.1:59004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 340.209522] nixbot[3477]: INFO: ::ffff:127.0.0.1:59012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 341.267513] nixbot[3477]: INFO: ::ffff:127.0.0.1:35480 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 342.320367] nixbot[3477]: INFO: ::ffff:127.0.0.1:35488 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 343.374744] nixbot[3477]: INFO: ::ffff:127.0.0.1:35490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 344.429722] nixbot[3477]: INFO: ::ffff:127.0.0.1:35492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 345.484909] nixbot[3477]: INFO: ::ffff:127.0.0.1:35506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 346.535788] nixbot[3477]: INFO: ::ffff:127.0.0.1:35514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 347.589383] nixbot[3477]: INFO: ::ffff:127.0.0.1:35520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 348.643859] nixbot[3477]: INFO: ::ffff:127.0.0.1:35530 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 349.694502] nixbot[3477]: INFO: ::ffff:127.0.0.1:35536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 350.748279] nixbot[3477]: INFO: ::ffff:127.0.0.1:35552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 351.801197] nixbot[3477]: INFO: ::ffff:127.0.0.1:52616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 352.855269] nixbot[3477]: INFO: ::ffff:127.0.0.1:52618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 353.910767] nixbot[3477]: INFO: ::ffff:127.0.0.1:52626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 354.964893] nixbot[3477]: INFO: ::ffff:127.0.0.1:52636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 356.016260] nixbot[3477]: INFO: ::ffff:127.0.0.1:52648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 357.072414] nixbot[3477]: INFO: ::ffff:127.0.0.1:52660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 358.127475] nixbot[3477]: INFO: ::ffff:127.0.0.1:52670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 359.181245] nixbot[3477]: INFO: ::ffff:127.0.0.1:52678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 360.236869] nixbot[3477]: INFO: ::ffff:127.0.0.1:52692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 361.291696] nixbot[3477]: INFO: ::ffff:127.0.0.1:40044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 362.346930] nixbot[3477]: INFO: ::ffff:127.0.0.1:40050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 363.191169] sidekiq-cluster[3426]: 2026-08-16T18:01:31.056Z pid=3426 tid=yq2 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3426, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425766912} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 363.404332] nixbot[3477]: INFO: ::ffff:127.0.0.1:40054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 363.471615] sidekiq-cluster[3426]: W, [2026-08-16T18:01:31.337713 #3426] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 363.606703] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:01:31.472Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 364.456361] nixbot[3477]: INFO: ::ffff:127.0.0.1:40062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 365.508366] nixbot[3477]: INFO: ::ffff:127.0.0.1:40074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 366.524152] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:01:34.388Z","message":"GitLab reliable fetch activated!"} gitlab # [ 366.524587] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:01:34.388Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 366.563393] nixbot[3477]: INFO: ::ffff:127.0.0.1:40078 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 367.617157] nixbot[3477]: INFO: ::ffff:127.0.0.1:40080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 368.672081] nixbot[3477]: INFO: ::ffff:127.0.0.1:40096 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 369.724575] nixbot[3477]: INFO: ::ffff:127.0.0.1:40112 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 370.777535] nixbot[3477]: INFO: ::ffff:127.0.0.1:40116 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 371.832394] nixbot[3477]: INFO: ::ffff:127.0.0.1:45982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 372.887390] nixbot[3477]: INFO: ::ffff:127.0.0.1:45994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 373.942003] nixbot[3477]: INFO: ::ffff:127.0.0.1:46004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 374.996704] nixbot[3477]: INFO: ::ffff:127.0.0.1:46016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 376.046947] nixbot[3477]: INFO: ::ffff:127.0.0.1:46024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 377.098682] nixbot[3477]: INFO: ::ffff:127.0.0.1:46034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 378.150920] nixbot[3477]: INFO: ::ffff:127.0.0.1:46044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 379.205194] nixbot[3477]: INFO: ::ffff:127.0.0.1:46060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 380.257627] nixbot[3477]: INFO: ::ffff:127.0.0.1:46072 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 381.310573] nixbot[3477]: INFO: ::ffff:127.0.0.1:35238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 382.362271] nixbot[3477]: INFO: ::ffff:127.0.0.1:35248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 383.416314] nixbot[3477]: INFO: ::ffff:127.0.0.1:35264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 384.467593] nixbot[3477]: INFO: ::ffff:127.0.0.1:35274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 385.522169] nixbot[3477]: INFO: ::ffff:127.0.0.1:35282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 386.575779] nixbot[3477]: INFO: ::ffff:127.0.0.1:35296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 387.630305] nixbot[3477]: INFO: ::ffff:127.0.0.1:35306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 388.684926] nixbot[3477]: INFO: ::ffff:127.0.0.1:35308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 389.738811] nixbot[3477]: INFO: ::ffff:127.0.0.1:35322 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 390.792554] nixbot[3477]: INFO: ::ffff:127.0.0.1:35330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 391.846671] nixbot[3477]: INFO: ::ffff:127.0.0.1:56740 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 392.902072] nixbot[3477]: INFO: ::ffff:127.0.0.1:56752 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 393.958195] nixbot[3477]: INFO: ::ffff:127.0.0.1:56758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 395.011251] nixbot[3477]: INFO: ::ffff:127.0.0.1:56760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 396.065139] nixbot[3477]: INFO: ::ffff:127.0.0.1:56776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 397.117496] nixbot[3477]: INFO: ::ffff:127.0.0.1:56782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 398.168095] nixbot[3477]: INFO: ::ffff:127.0.0.1:56794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 399.220263] nixbot[3477]: INFO: ::ffff:127.0.0.1:56800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 400.274375] nixbot[3477]: INFO: ::ffff:127.0.0.1:56808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 401.330579] nixbot[3477]: INFO: ::ffff:127.0.0.1:49388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 402.381620] nixbot[3477]: INFO: ::ffff:127.0.0.1:49396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 402.738927] postgres[3999]: [3999] ERROR: relation "table_without_models" does not exist gitlab # [ 402.742599] postgres[3999]: [3999] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 403.437421] nixbot[3477]: INFO: ::ffff:127.0.0.1:49406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 404.491368] nixbot[3477]: INFO: ::ffff:127.0.0.1:49422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 405.546184] nixbot[3477]: INFO: ::ffff:127.0.0.1:49428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 406.598550] nixbot[3477]: INFO: ::ffff:127.0.0.1:49430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 407.559103] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:15.424Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 407.561605] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:15.427Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 407.564215] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:15.429Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 407.568259] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:15.430Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 407.570333] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:15.433Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 407.649954] nixbot[3477]: INFO: ::ffff:127.0.0.1:49438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 408.703260] nixbot[3477]: INFO: ::ffff:127.0.0.1:49452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 409.755984] nixbot[3477]: INFO: ::ffff:127.0.0.1:49456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 410.242101] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.106Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b0935f02ea1bfeb25ad85f71","created_at":"2026-08-16T18:00:47.643Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:47.713Z","job_size_bytes":2,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b0935f02ea1bfeb25ad85f71: start","job_status":"start","queue_duration_s":90.39315,"scheduling_latency_s":90.393204} gitlab # [ 410.528813] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.393Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b0935f02ea1bfeb25ad85f71","created_at":"2026-08-16T18:00:47.643Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:47.713Z","job_size_bytes":2,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b0935f02ea1bfeb25ad85f71: done: 0.286955 sec","job_status":"done","queue_duration_s":90.39315,"scheduling_latency_s":90.393204,"redis_calls":23,"redis_duration_s":0.008248,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004129,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002371,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16367736,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.286955,"completed_at":"2026-08-16T18:02:18.393Z","load_balancing_strategy":"primary","db_duration_s":0.106896,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 410.624092] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.396Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"75f77c8bc971a632ff4360ca","created_at":"2026-08-16T18:00:47.736Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:47.745Z","job_size_bytes":2,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-75f77c8bc971a632ff4360ca: start","job_status":"start","queue_duration_s":90.651186,"scheduling_latency_s":90.651229} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 410.706542] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.572Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"75f77c8bc971a632ff4360ca","created_at":"2026-08-16T18:00:47.736Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:47.745Z","job_size_bytes":2,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-75f77c8bc971a632ff4360ca: done: 0.175435 sec","job_status":"done","queue_duration_s":90.651186,"scheduling_latency_s":90.651229,"redis_calls":14,"redis_duration_s":0.004157,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001886,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13846889999999998,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.175435,"completed_at":"2026-08-16T18:02:18.571Z","load_balancing_strategy":"primary","db_duration_s":0.036,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 410.799910] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.574Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3260b3572884dc05b022fb4d","created_at":"2026-08-16T18:00:48.507Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:48.516Z","job_size_bytes":5,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3260b3572884dc05b022fb4d: start","job_status":"start","queue_duration_s":90.05784,"scheduling_latency_s":90.057863} gitlab # [ 410.825157] nixbot[3477]: INFO: ::ffff:127.0.0.1:49468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 410.906768] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.772Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"3260b3572884dc05b022fb4d","created_at":"2026-08-16T18:00:48.507Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:48.516Z","job_size_bytes":5,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-3260b3572884dc05b022fb4d: done: 0.198375 sec","job_status":"done","queue_duration_s":90.05784,"scheduling_latency_s":90.057863,"redis_calls":12,"redis_duration_s":0.0036,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002064,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.145868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053488,"duration_s":0.198375,"completed_at":"2026-08-16T18:02:18.772Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04567,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 410.999175] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:18.774Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"677afd78e201a02b6682756e","created_at":"2026-08-16T18:00:48.575Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:48.585Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-677afd78e201a02b6682756e: start","job_status":"start","queue_duration_s":90.188686,"scheduling_latency_s":90.188708} gitlab # [ 411.196077] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:19.061Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"677afd78e201a02b6682756e","created_at":"2026-08-16T18:00:48.575Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:48.585Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-677afd78e201a02b6682756e: done: 0.2869 sec","job_status":"done","queue_duration_s":90.188686,"scheduling_latency_s":90.188708,"redis_calls":11,"redis_duration_s":0.003117,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000819,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.244,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.244,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005003,"duration_s":0.2869,"completed_at":"2026-08-16T18:02:19.061Z","load_balancing_strategy":"primary","db_duration_s":0.117426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 411.299746] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:19.063Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"ec3944f9e93e6d8f470cae52","created_at":"2026-08-16T18:00:48.593Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:48.601Z","job_size_bytes":89,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-ec3944f9e93e6d8f470cae52: start","job_status":"start","queue_duration_s":90.462036,"scheduling_latency_s":90.462059} gitlab # [ 411.325508] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:19.111Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"ec3944f9e93e6d8f470cae52","created_at":"2026-08-16T18:00:48.593Z","trace_propagation_headers":{"sentry-trace":"fb96b7ac28b9453cab2a5c622f7bcf7b-b1b914c4f1ea42a4","baggage":"sentry-trace_id=fb96b7ac28b9453cab2a5c622f7bcf7b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQCTSFXQE9TAS2AJG085D","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:48.601Z","job_size_bytes":89,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-ec3944f9e93e6d8f470cae52: done: 0.04757 sec","job_status":"done","queue_duration_s":90.462036,"scheduling_latency_s":90.462059,"redis_calls":11,"redis_duration_s":0.003188,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000888,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048442,"duration_s":0.04757,"completed_at":"2026-08-16T18:02:19.111Z","load_balancing_strategy":"primary","db_duration_s":0.009071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 411.374418] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:19.113Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a623a273f2968e5a001506d6f5348a90c585e710 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f2f47d09fa2629dedeac7ad4","created_at":"2026-08-16T18:00:51.044Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-745000ddbb634d1c","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:51.096Z","job_size_bytes":185,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f2f47d09fa2629dedeac7ad4: start","job_status":"start","queue_duration_s":88.0168,"scheduling_latency_s":88.016823} gitlab # [ 411.391482] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:19.133Z","message":"changes: \"0000000000000000000000000000000000000000 a623a273f2968e5a001506d6f5348a90c585e710 refs/heads/master\\n\""} gitlab # [ 411.394359] gitaly[893]: time="2026-08-16T18:02:19.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:29.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:19.167" grpc.time_ms=13.084 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.407681] gitaly[893]: time="2026-08-16T18:02:19.199Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:02:29.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:19.186" grpc.time_ms=12.983 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.421017] gitaly[893]: time="2026-08-16T18:02:19.272Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T18:02:29.093" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:19.253" grpc.time_ms=18.687 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.460212] gitaly[893]: time="2026-08-16T18:02:19.326Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:19.325" grpc.time_ms=0.684 pid=893 span.kind=server system=grpc gitlab # [ 411.491331] gitaly[893]: time="2026-08-16T18:02:19.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:19.356" grpc.time_ms=0.742 pid=893 span.kind=server system=grpc gitlab # [ 411.506988] gitaly[893]: time="2026-08-16T18:02:19.366Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E diskcache=e273b291-c391-4360-b2e0-ea644ae57996 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T18:02:29.126" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:19.286" pid=893 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 411.521572] gitaly[893]: time="2026-08-16T18:02:19.366Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=82 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5161 command.oublock=8 command.real_time_ms=74 command.spawn_token_fork_ms=1 command.system_time_ms=52 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T18:02:29.126" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:19.286" grpc.time_ms=79.934 pid=893 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 411.538126] gitaly[893]: time="2026-08-16T18:02:19.395Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T18:02:29.234" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:19.395" grpc.time_ms=0.268 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.557393] gitaly[893]: time="2026-08-16T18:02:19.423Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T18:02:29.241" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:19.401" grpc.time_ms=21.686 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.713574] gitaly[893]: time="2026-08-16T18:02:19.579Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T18:02:49.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:19.568" grpc.time_ms=11.217 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.775690] gitaly[893]: time="2026-08-16T18:02:19.641Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T18:02:29.000" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:19.641" grpc.time_ms=0.389 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 411.807011] gitaly[893]: time="2026-08-16T18:02:19.654Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T18:02:29.005" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T18:02:19.645" grpc.time_ms=8.673 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.836761] gitaly[893]: time="2026-08-16T18:02:19.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:29.040" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:19.681" grpc.time_ms=12.35 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.862975] gitaly[893]: time="2026-08-16T18:02:19.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:29.062" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:19.702" grpc.time_ms=17.269 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.06 seconds) gitlab # [ 411.884652] nixbot[3477]: INFO: ::ffff:127.0.0.1:59782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 411.905403] gitaly[893]: time="2026-08-16T18:02:19.771Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T18:02:49.244" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:19.744" grpc.time_ms=26.598 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.533577] gitaly[893]: time="2026-08-16T18:02:20.399Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T18:02:30.236" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:20.396" grpc.time_ms=2.341 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.603844] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.467Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a623a273f2968e5a001506d6f5348a90c585e710 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f2f47d09fa2629dedeac7ad4","created_at":"2026-08-16T18:00:51.044Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-745000ddbb634d1c","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:51.096Z","job_size_bytes":185,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f2f47d09fa2629dedeac7ad4: done: 1.354631 sec","job_status":"done","queue_duration_s":88.0168,"scheduling_latency_s":88.016823,"gitaly_calls":13,"gitaly_duration_s":0.279043,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.05856,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.006168,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008536,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001951,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004894,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.022305,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014706,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.276,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.32,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.930319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073938,"exclusive_lock_hold_duration_s":0.036584179999999994,"duration_s":1.354631,"completed_at":"2026-08-16T18:02:20.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.150859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 412.682915] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.471Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a623a273f2968e5a001506d6f5348a90c585e710 6908e42eeb287c530a84b8de9235b4e032dd36fd refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4658fea9ca6ca925adf06ecf","created_at":"2026-08-16T18:00:56.260Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-fa6937598ee344b8","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:56.264Z","job_size_bytes":185,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4658fea9ca6ca925adf06ecf: start","job_status":"start","queue_duration_s":84.207252,"scheduling_latency_s":84.207295} gitlab # [ 412.701646] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.494Z","message":"changes: \"a623a273f2968e5a001506d6f5348a90c585e710 6908e42eeb287c530a84b8de9235b4e032dd36fd refs/heads/master\\n\""} gitlab # [ 412.704033] gitaly[893]: time="2026-08-16T18:02:20.543Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:30.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:20.528" grpc.time_ms=14.787 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.716986] gitaly[893]: time="2026-08-16T18:02:20.565Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T18:02:30.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:20.550" grpc.time_ms=15.227 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.730406] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.574Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a657bd31afcd686e4318b7e0","created_at":"2026-08-16T18:02:20.570Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"b83950de250476d8735ed4fa","job_size_bytes":46,"pid":3426,"job_status":"deduplicated","message":"ProjectCacheWorker JID-a657bd31afcd686e4318b7e0: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 412.750874] gitaly[893]: time="2026-08-16T18:02:20.616Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T18:02:30.080" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:20.600" grpc.time_ms=16.087 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.777140] gitaly[893]: time="2026-08-16T18:02:20.643Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T18:02:50.124" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:20.624" grpc.time_ms=18.225 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.805528] gitaly[893]: time="2026-08-16T18:02:20.671Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T18:02:30.023" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T18:02:20.664" grpc.time_ms=7.411 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.836675] gitaly[893]: time="2026-08-16T18:02:20.702Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:30.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:20.687" grpc.time_ms=15.264 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.04 seconds) gitlab # [ 412.925826] nixbot[3477]: INFO: ::ffff:127.0.0.1:59794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 412.969343] gitaly[893]: time="2026-08-16T18:02:20.835Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T18:02:30.192" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:20.833" grpc.time_ms=2.103 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.006725] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.861Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a623a273f2968e5a001506d6f5348a90c585e710 6908e42eeb287c530a84b8de9235b4e032dd36fd refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4658fea9ca6ca925adf06ecf","created_at":"2026-08-16T18:00:56.260Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-fa6937598ee344b8","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T18:00:56.264Z","job_size_bytes":185,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4658fea9ca6ca925adf06ecf: done: 0.390468 sec","job_status":"done","queue_duration_s":84.207252,"scheduling_latency_s":84.207295,"gitaly_calls":7,"gitaly_duration_s":0.115701,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.031418,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003499,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001893,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004144,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010823,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.011059,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.041,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.041,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.232904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00151434,"exclusive_lock_hold_duration_s":0.0326592,"duration_s":0.390468,"completed_at":"2026-08-16T18:02:20.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0372,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 413.085289] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.863Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8b6c4ceceb0501d0eb61a115","created_at":"2026-08-16T18:00:57.832Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-113a03ecd4d548f0","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:57.871Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8b6c4ceceb0501d0eb61a115: start","job_status":"start","queue_duration_s":82.992329,"scheduling_latency_s":82.992357} gitlab # [ 413.109845] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.975Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8b6c4ceceb0501d0eb61a115","created_at":"2026-08-16T18:00:57.832Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-113a03ecd4d548f0","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:57.871Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8b6c4ceceb0501d0eb61a115: done: 0.111591 sec","job_status":"done","queue_duration_s":82.992329,"scheduling_latency_s":82.992357,"redis_calls":16,"redis_duration_s":0.0052899999999999996,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002878,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042806,"duration_s":0.111591,"completed_at":"2026-08-16T18:02:20.975Z","load_balancing_strategy":"primary","db_duration_s":0.029261,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 413.154760] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:20.977Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9431da627af1ea63f379b5b","created_at":"2026-08-16T18:00:57.873Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-113a03ecd4d548f0","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:57.885Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9431da627af1ea63f379b5b: start","job_status":"start","queue_duration_s":83.091548,"scheduling_latency_s":83.091571} gitlab # [ 413.358794] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:21.224Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9431da627af1ea63f379b5b","created_at":"2026-08-16T18:00:57.873Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-113a03ecd4d548f0","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:57.885Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9431da627af1ea63f379b5b: done: 0.247044 sec","job_status":"done","queue_duration_s":83.091548,"scheduling_latency_s":83.091571,"redis_calls":21,"redis_duration_s":0.00578,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002426,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001616,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.198459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044746,"duration_s":0.247044,"completed_at":"2026-08-16T18:02:21.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 413.459991] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:21.226Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7756817880e585f42d38986f","created_at":"2026-08-16T18:00:58.084Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-113a03ecd4d548f0","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:58.092Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7756817880e585f42d38986f: start","job_status":"start","queue_duration_s":83.133629,"scheduling_latency_s":83.133648} gitlab # [ 413.640131] gitaly[893]: time="2026-08-16T18:02:21.504Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:21.503" grpc.time_ms=0.858 pid=893 span.kind=server system=grpc gitlab # [ 413.692804] gitaly[893]: time="2026-08-16T18:02:21.558Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:21.558" grpc.time_ms=0.763 pid=893 span.kind=server system=grpc gitlab # [ 413.752616] gitaly[893]: time="2026-08-16T18:02:21.618Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:21.617" grpc.time_ms=0.861 pid=893 span.kind=server system=grpc gitlab # [ 413.772247] gitaly[893]: time="2026-08-16T18:02:21.631Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 diskcache=a77d03c9-106b-4677-9c42-278f0242cfe5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:02:51.042" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:21.443" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.790777] gitaly[893]: time="2026-08-16T18:02:21.632Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=209 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7598 command.oublock=0 command.real_time_ms=181 command.spawn_token_fork_ms=1 command.system_time_ms=131 command.user_time_ms=78 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:02:51.042" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:21.443" grpc.time_ms=188.798 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 413.984978] nixbot[3477]: INFO: ::ffff:127.0.0.1:59800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.07 seconds) gitlab # [ 413.992219] gitaly[893]: time="2026-08-16T18:02:21.853Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:02:51.350" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:21.851" grpc.time_ms=1.5 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.040949] gitaly[893]: time="2026-08-16T18:02:21.906Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQR1RGRX2CHTXT5KRFV52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:51.405" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:21.905" grpc.time_ms=1.12 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.086293] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:21.950Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7756817880e585f42d38986f","created_at":"2026-08-16T18:00:58.084Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-113a03ecd4d548f0","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:00:58.092Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7756817880e585f42d38986f: done: 0.72425 sec","job_status":"done","queue_duration_s":83.133629,"scheduling_latency_s":83.133648,"gitaly_calls":3,"gitaly_duration_s":0.202947,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.044464,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001687,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001725,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015832,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.007991,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.010477,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001005,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000975,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003085,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.095,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.037,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.048,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.395991,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.63530086,"duration_s":0.72425,"completed_at":"2026-08-16T18:02:21.950Z","load_balancing_strategy":"primary","db_duration_s":0.109618,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 414.181486] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:21.953Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b83950de250476d8735ed4fa","created_at":"2026-08-16T18:02:19.202Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:19.222Z","job_size_bytes":46,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b83950de250476d8735ed4fa: start","job_status":"start","queue_duration_s":2.731467,"scheduling_latency_s":2.731516} gitlab # [ 414.200600] gitaly[893]: time="2026-08-16T18:02:22.038Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-17T00:02:22.034" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:22.034" grpc.time_ms=4.013 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.212522] gitaly[893]: time="2026-08-16T18:02:22.061Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T18:02:52.050" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.051" grpc.time_ms=9.774 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.227008] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:22.092Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b83950de250476d8735ed4fa","created_at":"2026-08-16T18:02:19.202Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:19.222Z","job_size_bytes":46,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b83950de250476d8735ed4fa: done: 0.138927 sec","job_status":"done","queue_duration_s":2.731467,"scheduling_latency_s":2.731516,"gitaly_calls":2,"gitaly_duration_s":0.019327,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009678,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001828,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000629,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002062,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.00406,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037326,"duration_s":0.138927,"completed_at":"2026-08-16T18:02:22.092Z","load_balancing_strategy":"primary","db_duration_s":0.017017,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 414.277289] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:22.094Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a71d7e34a2bce6453a2d9dd8","created_at":"2026-08-16T18:02:19.243Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:19.249Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a71d7e34a2bce6453a2d9dd8: start","job_status":"start","queue_duration_s":2.845342,"scheduling_latency_s":2.845364} gitlab # [ 414.294725] gitaly[893]: time="2026-08-16T18:02:22.150Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E diskcache=370468fe-c34a-4d08-93f1-d68af06cc067 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T00:02:22.123" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.123" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.304770] gitaly[893]: time="2026-08-16T18:02:22.150Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T00:02:22.123" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.123" grpc.time_ms=26.484 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.331509] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:22.197Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a71d7e34a2bce6453a2d9dd8","created_at":"2026-08-16T18:02:19.243Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:19.249Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a71d7e34a2bce6453a2d9dd8: done: 0.102797 sec","job_status":"done","queue_duration_s":2.845342,"scheduling_latency_s":2.845364,"gitaly_calls":1,"gitaly_duration_s":0.02906,"redis_calls":15,"redis_duration_s":0.004233,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000756,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.025,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0747411,"duration_s":0.102797,"completed_at":"2026-08-16T18:02:22.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.379879] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:22.199Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"bc446011ce10f0f5630b237c","created_at":"2026-08-16T18:02:19.386Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:19.390Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bc446011ce10f0f5630b237c: start","job_status":"start","queue_duration_s":2.808779,"scheduling_latency_s":2.8088} gitlab # [ 414.396078] gitaly[893]: time="2026-08-16T18:02:22.246Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T18:02:52.229" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.229" grpc.time_ms=16.184 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.409229] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:22.254Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"bc446011ce10f0f5630b237c","created_at":"2026-08-16T18:02:19.386Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:19.390Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bc446011ce10f0f5630b237c: done: 0.055701 sec","job_status":"done","queue_duration_s":2.808779,"scheduling_latency_s":2.8088,"gitaly_calls":1,"gitaly_duration_s":0.018303,"redis_calls":16,"redis_duration_s":0.004328,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000247,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001951,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055701,"completed_at":"2026-08-16T18:02:22.254Z","load_balancing_strategy":"primary","db_duration_s":0.004383,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 414.454331] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:22.257Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3e3f985ecb2185b1165d4cfd","created_at":"2026-08-16T18:02:20.122Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:444ce62af91b008eded38e5cc211334471e213e8a91e34dc43e2bf46be2fe12d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.133Z","job_size_bytes":467,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3e3f985ecb2185b1165d4cfd: start","job_status":"start","queue_duration_s":2.123497,"scheduling_latency_s":2.123518} gitlab # [ 414.471627] gitaly[893]: time="2026-08-16T18:02:22.287Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:52.286" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.286" grpc.time_ms=0.992 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.484207] gitaly[893]: time="2026-08-16T18:02:22.301Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T18:02:32.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:22.290" grpc.time_ms=10.805 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.567870] gitaly[893]: time="2026-08-16T18:02:22.433Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:02:52.432" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.432" grpc.time_ms=0.999 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.581186] gitaly[893]: time="2026-08-16T18:02:22.440Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=27 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T18:02:52.437" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:22.437" grpc.time_ms=3.039 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.686182] gitaly[893]: time="2026-08-16T18:02:22.551Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:32.254" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:22.534" grpc.time_ms=16.479 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.07 seconds) gitlab # [ 415.056971] nixbot[3477]: INFO: ::ffff:127.0.0.1:59810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 415.432959] gitaly[893]: time="2026-08-16T18:02:23.298Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T18:02:53.271" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.271" grpc.time_ms=26.996 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.475181] gitaly[893]: time="2026-08-16T18:02:23.327Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQGZ7MP4AHWSR2FFK1D5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T18:02:53.304" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.304" grpc.time_ms=22.797 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.523729] sidekiq-cluster[3426]: {"severity":"WARN","time":"2026-08-16T18:02:23.389Z","class":"CreatePipelineWorker","correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a623a273f2968e5a001506d6f5348a90c585e710","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a623a273f2968e5a001506d6f5348a90c585e710","ref":"refs/heads/master"},"retry":0} gitlab # [ 415.539439] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:23.404Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3e3f985ecb2185b1165d4cfd","created_at":"2026-08-16T18:02:20.122Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:444ce62af91b008eded38e5cc211334471e213e8a91e34dc43e2bf46be2fe12d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.133Z","job_size_bytes":467,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3e3f985ecb2185b1165d4cfd: done: 1.147 sec","job_status":"done","queue_duration_s":2.123497,"scheduling_latency_s":2.123518,"gitaly_calls":7,"gitaly_duration_s":0.101444,"redis_calls":51,"redis_duration_s":0.013583999999999999,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001092,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005532,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003042,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001989,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.963889,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060192,"duration_s":1.147,"completed_at":"2026-08-16T18:02:23.404Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080753,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 415.609745] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:23.407Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f299cf27-3ef7-4dff-a9c0-0860a97e58ca\"}"],"class":"WebHookWorker","jid":"0aeb6a33871193aee9733fd2","created_at":"2026-08-16T18:02:20.360Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3323a28b1d155e4ca1c9f38b9559b971eacc60619b6b68fc0bba69c57b7c016d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.365Z","job_size_bytes":1751,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0aeb6a33871193aee9733fd2: start","job_status":"start","queue_duration_s":3.041847,"scheduling_latency_s":3.041884} gitlab # [ 415.748451] nixbot[3477]: INFO: ::ffff:127.0.0.1:59816 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 415.789705] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:23.654Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f299cf27-3ef7-4dff-a9c0-0860a97e58ca\"}"],"class":"WebHookWorker","jid":"0aeb6a33871193aee9733fd2","created_at":"2026-08-16T18:02:20.360Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c04d157ea62a47fe","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3323a28b1d155e4ca1c9f38b9559b971eacc60619b6b68fc0bba69c57b7c016d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.365Z","job_size_bytes":1751,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-0aeb6a33871193aee9733fd2: done: 0.246869 sec","job_status":"done","queue_duration_s":3.041847,"scheduling_latency_s":3.041884,"redis_calls":19,"redis_duration_s":0.006112,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001467,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.0006,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002646,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08989100000002281,"cpu_s":0.133986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059446,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.246869,"completed_at":"2026-08-16T18:02:23.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.899610] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:23.658Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"00c4555f41b7e8aa53b2b7bd","created_at":"2026-08-16T18:02:20.587Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"a71d7e34a2bce6453a2d9dd8","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.593Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-00c4555f41b7e8aa53b2b7bd: start","job_status":"start","queue_duration_s":3.065247,"scheduling_latency_s":3.065295} gitlab # [ 415.923214] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:23.755Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"00c4555f41b7e8aa53b2b7bd","created_at":"2026-08-16T18:02:20.587Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"a71d7e34a2bce6453a2d9dd8","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.593Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-00c4555f41b7e8aa53b2b7bd: done: 0.096984 sec","job_status":"done","queue_duration_s":3.065247,"scheduling_latency_s":3.065295,"gitaly_calls":1,"gitaly_duration_s":0.01965,"redis_calls":12,"redis_duration_s":0.009076,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.005208,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05420356,"duration_s":0.096984,"completed_at":"2026-08-16T18:02:23.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.971521] gitaly[893]: time="2026-08-16T18:02:23.721Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 diskcache=c493b571-1af2-4678-a4d2-cc2a70b113bd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T00:02:23.706" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.706" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.982724] gitaly[893]: time="2026-08-16T18:02:23.721Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-17T00:02:23.706" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.706" grpc.time_ms=14.373 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.996115] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 163 gitlab # [ 415.998188] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:23.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fd7bf745f509236ef326efa9","created_at":"2026-08-16T18:02:20.786Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31cfc1c56e434d127ec8aa9ca6407f41000b736b1e9710dbade82b12f16dc07e","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.790Z","job_size_bytes":467,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fd7bf745f509236ef326efa9: start","job_status":"start","queue_duration_s":2.967803,"scheduling_latency_s":2.967837} gitlab # [ 416.015756] gitaly[893]: time="2026-08-16T18:02:23.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:53.793" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.794" grpc.time_ms=0.788 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.028388] gitaly[893]: time="2026-08-16T18:02:23.809Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T18:02:33.277" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:23.798" grpc.time_ms=10.698 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.041055] gitaly[893]: time="2026-08-16T18:02:23.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTCHNEXVMQVKNC1CHR4NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:23.818" grpc.time_ms=12.686 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 416.054182] gitaly[893]: time="2026-08-16T18:02:23.877Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:02:53.875" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.876" grpc.time_ms=1.264 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.066535] gitaly[893]: time="2026-08-16T18:02:23.887Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=49 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T18:02:53.883" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:23.883" grpc.time_ms=3.582 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.081982] gitaly[893]: time="2026-08-16T18:02:23.942Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:33.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:23.930" grpc.time_ms=11.896 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.106031] nixbot[3477]: INFO: ::ffff:127.0.0.1:59830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.05 seconds) gitlab # [ 416.243469] gitaly[893]: time="2026-08-16T18:02:24.109Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTCPV3G1NRYKDHBXPZXEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.091" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 416.273108] gitaly[893]: time="2026-08-16T18:02:24.109Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTCPV3G1NRYKDHBXPZXEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.091" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 416.299175] gitlab-workhorse[819]: time="2026-08-16T18:02:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 416.302850] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 275 gitlab # [ 416.306266] nixbot[3477]: {"ts": "2026-08-16T18:02:24.154Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 416.310683] gitaly[893]: time="2026-08-16T18:02:24.110Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTCPV3G1NRYKDHBXPZXEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.091" grpc.time_ms=18.722 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 416.375089] gitaly[893]: time="2026-08-16T18:02:24.241Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:54.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:24.240" grpc.time_ms=0.856 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.460647] gitaly[893]: time="2026-08-16T18:02:24.326Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:34.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:24.309" grpc.time_ms=16.901 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.523718] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 221 gitlab # [ 416.532218] nixbot[3477]: {"ts": "2026-08-16T18:02:24.390Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 416.595544] gitaly[893]: time="2026-08-16T18:02:24.461Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTD8AQPXQJ9TNDT9FDXBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:54.460" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:24.460" grpc.time_ms=0.756 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.653729] gitaly[893]: time="2026-08-16T18:02:24.519Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTD8AQPXQJ9TNDT9FDXBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:34.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:24.503" grpc.time_ms=16.257 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.707522] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 178 gitlab # [ 416.717214] nixbot[3477]: {"ts": "2026-08-16T18:02:24.574Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 416.757778] gitaly[893]: time="2026-08-16T18:02:24.623Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T18:02:54.600" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:24.600" grpc.time_ms=22.67 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.799956] gitaly[893]: time="2026-08-16T18:02:24.642Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDE56HXZXZT62Y710MN8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:54.641" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:24.641" grpc.time_ms=0.864 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.827039] sidekiq-cluster[3426]: {"severity":"WARN","time":"2026-08-16T18:02:24.665Z","class":"CreatePipelineWorker","correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a623a273f2968e5a001506d6f5348a90c585e710","after":"6908e42eeb287c530a84b8de9235b4e032dd36fd","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"6908e42eeb287c530a84b8de9235b4e032dd36fd","ref":"refs/heads/master"},"retry":0} gitlab # [ 416.838928] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fd7bf745f509236ef326efa9","created_at":"2026-08-16T18:02:20.786Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31cfc1c56e434d127ec8aa9ca6407f41000b736b1e9710dbade82b12f16dc07e","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.790Z","job_size_bytes":467,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fd7bf745f509236ef326efa9: done: 0.914193 sec","job_status":"done","queue_duration_s":2.967803,"scheduling_latency_s":2.967837,"gitaly_calls":7,"gitaly_duration_s":0.095379,"redis_calls":33,"redis_duration_s":0.011212,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.002817,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005729,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.78427,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.914193,"completed_at":"2026-08-16T18:02:24.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034075,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 416.907588] gitaly[893]: time="2026-08-16T18:02:24.650Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VQPMEVQ7E098KC1TKVMG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T18:02:54.625" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:24.626" grpc.time_ms=23.93 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.922725] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 186 gitlab # [ 416.925600] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.675Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"6f602ad8-28d8-4b12-af74-38afb7b74918\"}"],"class":"WebHookWorker","jid":"f7aaa4ebcff25cd66af4128c","created_at":"2026-08-16T18:02:20.813Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:882a07ac1f54581a227cc5bfade16af38c249ed687f8c37b36a8a453ccf4a639","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.816Z","job_size_bytes":1749,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-f7aaa4ebcff25cd66af4128c: start","job_status":"start","queue_duration_s":3.859391,"scheduling_latency_s":3.859423} gitlab # [ 416.945145] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.733Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"6f602ad8-28d8-4b12-af74-38afb7b74918\"}"],"class":"WebHookWorker","jid":"f7aaa4ebcff25cd66af4128c","created_at":"2026-08-16T18:02:20.813Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-f8a228fc52f1437f","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:882a07ac1f54581a227cc5bfade16af38c249ed687f8c37b36a8a453ccf4a639","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:20.816Z","job_size_bytes":1749,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-f7aaa4ebcff25cd66af4128c: done: 0.057755 sec","job_status":"done","queue_duration_s":3.859391,"scheduling_latency_s":3.859423,"redis_calls":14,"redis_duration_s":0.008667000000000001,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000526,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00515,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002991,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007701020000013159,"cpu_s":0.028007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.057755,"completed_at":"2026-08-16T18:02:24.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 416.992718] nixbot[3477]: INFO: ::ffff:127.0.0.1:59834 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 416.993906] nixbot[3477]: {"ts": "2026-08-16T18:02:24.769Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a623a273f2968e5a001506d6f5348a90c585e710 \"HTTP/1.1 201 Created\""} gitlab # [ 416.996911] gitaly[893]: time="2026-08-16T18:02:24.690Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05VTDE56HXZXZT62Y710MN8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:34.181" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:24.681" grpc.time_ms=8.733 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.011487] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8359649598e2dc1848244296","created_at":"2026-08-16T18:02:21.403Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.415Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8359649598e2dc1848244296: start","job_status":"start","queue_duration_s":3.320013,"scheduling_latency_s":3.320034} gitlab # [ 417.028149] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.841Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8359649598e2dc1848244296","created_at":"2026-08-16T18:02:21.403Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.415Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8359649598e2dc1848244296: done: 0.105919 sec","job_status":"done","queue_duration_s":3.320013,"scheduling_latency_s":3.320034,"redis_calls":10,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000318,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023352,"duration_s":0.105919,"completed_at":"2026-08-16T18:02:24.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026142,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 417.072788] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 89 gitlab # [ 417.074813] gitlab-workhorse[819]: time="2026-08-16T18:02:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 417.076673] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 74 gitlab # [ 417.078464] gitaly[893]: time="2026-08-16T18:02:24.836Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05VTDKB5G4RBKAHWFRQQKQP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.825" grpc.time_ms=11.247 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.091464] gitaly[893]: time="2026-08-16T18:02:24.912Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDP7GBEEF3172RQ0PY6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.903" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 417.101774] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"51881fabe375367af3dfd721","created_at":"2026-08-16T18:02:21.641Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.652Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-51881fabe375367af3dfd721: start","job_status":"start","queue_duration_s":3.190973,"scheduling_latency_s":3.190994} gitlab # [ 417.118122] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.880Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"51881fabe375367af3dfd721","created_at":"2026-08-16T18:02:21.641Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.652Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-51881fabe375367af3dfd721: done: 0.036923 sec","job_status":"done","queue_duration_s":3.190973,"scheduling_latency_s":3.190994,"redis_calls":10,"redis_duration_s":0.001672,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049166,"duration_s":0.036923,"completed_at":"2026-08-16T18:02:24.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.161836] gitaly[893]: time="2026-08-16T18:02:24.912Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDP7GBEEF3172RQ0PY6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.903" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.175244] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 72 gitlab # [ 417.177403] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.881Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5a86e56e75d1c9d4a61f2c18","created_at":"2026-08-16T18:02:21.681Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.692Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5a86e56e75d1c9d4a61f2c18: start","job_status":"start","queue_duration_s":3.188723,"scheduling_latency_s":3.188741} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.09 seconds) gitlab # [ 417.192988] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5a86e56e75d1c9d4a61f2c18","created_at":"2026-08-16T18:02:21.681Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.692Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5a86e56e75d1c9d4a61f2c18: done: 0.040334 sec","job_status":"done","queue_duration_s":3.188723,"scheduling_latency_s":3.188741,"redis_calls":10,"redis_duration_s":0.002756,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028872,"duration_s":0.040334,"completed_at":"2026-08-16T18:02:24.921Z","load_balancing_strategy":"primary","db_duration_s":0.004797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.237719] gitaly[893]: time="2026-08-16T18:02:24.913Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDP7GBEEF3172RQ0PY6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:24.903" grpc.time_ms=10.06 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.252370] gitlab-workhorse[819]: time="2026-08-16T18:02:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 417.254172] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 69 gitlab # [ 417.256059] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.923Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"130680a9db85049e0535bc71","created_at":"2026-08-16T18:02:21.724Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.735Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-130680a9db85049e0535bc71: start","job_status":"start","queue_duration_s":3.187292,"scheduling_latency_s":3.187312} gitlab # [ 417.271341] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.963Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"130680a9db85049e0535bc71","created_at":"2026-08-16T18:02:21.724Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.735Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-130680a9db85049e0535bc71: done: 0.040025 sec","job_status":"done","queue_duration_s":3.187292,"scheduling_latency_s":3.187312,"redis_calls":13,"redis_duration_s":0.001812,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000318,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024548,"duration_s":0.040025,"completed_at":"2026-08-16T18:02:24.963Z","load_balancing_strategy":"primary","db_duration_s":0.004593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.316590] nix-daemon[3692]: accepted connection from pid 4243, user nixbot gitlab # [ 417.317808] nixbot[3477]: INFO: ::ffff:127.0.0.1:59836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 417.319700] gitaly[893]: time="2026-08-16T18:02:25.023Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTDSQMA5EQ3YQ8RWJ1C93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.005" grpc.time_ms=18.489 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.332998] gitaly[893]: time="2026-08-16T18:02:25.094Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDW1F009EQ66P53CJEZP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.083" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 417.342934] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8d64d77a9ba21dcb8d996f9e","created_at":"2026-08-16T18:02:21.737Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.747Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8d64d77a9ba21dcb8d996f9e: start","job_status":"start","queue_duration_s":3.216727,"scheduling_latency_s":3.216747} gitlab # [ 417.359624] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:24.999Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8d64d77a9ba21dcb8d996f9e","created_at":"2026-08-16T18:02:21.737Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.747Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8d64d77a9ba21dcb8d996f9e: done: 0.034897 sec","job_status":"done","queue_duration_s":3.216727,"scheduling_latency_s":3.216747,"redis_calls":10,"redis_duration_s":0.001573,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033638,"duration_s":0.034897,"completed_at":"2026-08-16T18:02:24.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.403945] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 59 gitlab # [ 417.407312] gitaly[893]: time="2026-08-16T18:02:25.094Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDW1F009EQ66P53CJEZP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.083" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.421813] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.004Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ad093e388bb32c8b3e1ed8e","created_at":"2026-08-16T18:02:21.749Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.763Z","job_size_bytes":19,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ad093e388bb32c8b3e1ed8e: start","job_status":"start","queue_duration_s":3.240946,"scheduling_latency_s":3.240968} gitlab # [ 417.437815] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ad093e388bb32c8b3e1ed8e","created_at":"2026-08-16T18:02:21.749Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.763Z","job_size_bytes":19,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ad093e388bb32c8b3e1ed8e: done: 0.039779 sec","job_status":"done","queue_duration_s":3.240946,"scheduling_latency_s":3.240968,"redis_calls":11,"redis_duration_s":0.002027,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024718,"duration_s":0.039779,"completed_at":"2026-08-16T18:02:25.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.481691] gitlab-workhorse[819]: time="2026-08-16T18:02:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 417.483497] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 82 gitlab # [ 417.485501] gitaly[893]: time="2026-08-16T18:02:25.094Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTDW1F009EQ66P53CJEZP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.083" grpc.time_ms=10.511 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.499838] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.045Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7bf2eadfd2af3d3ebea28479","created_at":"2026-08-16T18:02:21.768Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.776Z","job_size_bytes":66,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7bf2eadfd2af3d3ebea28479: start","job_status":"start","queue_duration_s":3.268058,"scheduling_latency_s":3.268078} gitlab # [ 417.517328] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.083Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7bf2eadfd2af3d3ebea28479","created_at":"2026-08-16T18:02:21.768Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.776Z","job_size_bytes":66,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7bf2eadfd2af3d3ebea28479: done: 0.038552 sec","job_status":"done","queue_duration_s":3.268058,"scheduling_latency_s":3.268078,"redis_calls":10,"redis_duration_s":0.005619,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000337,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002508,"duration_s":0.038552,"completed_at":"2026-08-16T18:02:25.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004535,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.562621] gitaly[893]: time="2026-08-16T18:02:25.191Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05VTDZCETKT77TBF5ZHW7VV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.183" grpc.time_ms=8.355 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.575765] gitaly[893]: time="2026-08-16T18:02:25.276Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE1AWBWEWYE97QJMHWDR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.259" pid=893 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 417.586030] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.085Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"77d59b86442203baec71edb1","created_at":"2026-08-16T18:02:21.778Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.787Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-77d59b86442203baec71edb1: start","job_status":"start","queue_duration_s":3.298165,"scheduling_latency_s":3.298184} gitlab # [ 417.602477] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"77d59b86442203baec71edb1","created_at":"2026-08-16T18:02:21.778Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.787Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-77d59b86442203baec71edb1: done: 0.043339 sec","job_status":"done","queue_duration_s":3.298165,"scheduling_latency_s":3.298184,"redis_calls":10,"redis_duration_s":0.001447,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022674,"duration_s":0.043339,"completed_at":"2026-08-16T18:02:25.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.648440] gitaly[893]: time="2026-08-16T18:02:25.276Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE1AWBWEWYE97QJMHWDR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.259" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.662276] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.129Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"527d6ee9483326bd29d9cfa7","created_at":"2026-08-16T18:02:21.797Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.803Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-527d6ee9483326bd29d9cfa7: start","job_status":"start","queue_duration_s":3.326104,"scheduling_latency_s":3.326123} gitlab # [ 417.679338] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.165Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"527d6ee9483326bd29d9cfa7","created_at":"2026-08-16T18:02:21.797Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.803Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-527d6ee9483326bd29d9cfa7: done: 0.035835 sec","job_status":"done","queue_duration_s":3.326104,"scheduling_latency_s":3.326123,"redis_calls":10,"redis_duration_s":0.001345,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022872,"duration_s":0.035835,"completed_at":"2026-08-16T18:02:25.165Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.723969] gitaly[893]: time="2026-08-16T18:02:25.277Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE1AWBWEWYE97QJMHWDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:25.259" grpc.time_ms=17.027 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.739419] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.167Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"deb58a72aba790481cabfc0b","created_at":"2026-08-16T18:02:21.804Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.813Z","job_size_bytes":6,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-deb58a72aba790481cabfc0b: start","job_status":"start","queue_duration_s":3.353924,"scheduling_latency_s":3.353943} gitlab # [ 417.755806] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.194Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"deb58a72aba790481cabfc0b","created_at":"2026-08-16T18:02:21.804Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.813Z","job_size_bytes":6,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-deb58a72aba790481cabfc0b: done: 0.027094 sec","job_status":"done","queue_duration_s":3.353924,"scheduling_latency_s":3.353943,"redis_calls":10,"redis_duration_s":0.005567,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000371,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024778,"duration_s":0.027094,"completed_at":"2026-08-16T18:02:25.194Z","load_balancing_strategy":"primary","db_duration_s":0.001973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.799833] gitaly[893]: time="2026-08-16T18:02:25.369Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:55.368" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:25.369" grpc.time_ms=0.436 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.813860] nixbot[3477]: {"ts": "2026-08-16T18:02:25.643Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd \"HTTP/1.1 201 Created\""} gitlab # [ 417.816612] nixbot[3477]: {"ts": "2026-08-16T18:02:25.653Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-6908e42eeb28-4"} gitlab # [ 417.818863] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f0018bf746439a383a865837","created_at":"2026-08-16T18:02:21.814Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.819Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f0018bf746439a383a865837: start","job_status":"start","queue_duration_s":3.375284,"scheduling_latency_s":3.375302} gitlab # [ 417.834804] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.234Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f0018bf746439a383a865837","created_at":"2026-08-16T18:02:21.814Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.819Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f0018bf746439a383a865837: done: 0.039051 sec","job_status":"done","queue_duration_s":3.375284,"scheduling_latency_s":3.375302,"redis_calls":10,"redis_duration_s":0.0016769999999999999,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035256,"duration_s":0.039051,"completed_at":"2026-08-16T18:02:25.234Z","load_balancing_strategy":"primary","db_duration_s":0.006403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.877903] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 333 gitlab # [ 417.880317] gitaly[893]: time="2026-08-16T18:02:25.389Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T18:02:55.381" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:25.381" grpc.time_ms=7.435 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.894142] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.236Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"77f6665283526e8265c365e7","created_at":"2026-08-16T18:02:21.828Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.834Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-77f6665283526e8265c365e7: start","job_status":"start","queue_duration_s":3.401627,"scheduling_latency_s":3.401658} gitlab # [ 417.910076] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.320Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"77f6665283526e8265c365e7","created_at":"2026-08-16T18:02:21.828Z","trace_propagation_headers":{"sentry-trace":"bb4062958ae04a198bdeea411429a60f-95a65a79dff54e98","baggage":"sentry-trace_id=bb4062958ae04a198bdeea411429a60f,sentry-release=Unknown"},"correlation_id":"01M05VQR1RGRX2CHTXT5KRFV52","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:21.834Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-77f6665283526e8265c365e7: done: 0.084354 sec","job_status":"done","queue_duration_s":3.401627,"scheduling_latency_s":3.401658,"redis_calls":14,"redis_duration_s":0.003999,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002548,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030556,"duration_s":0.084354,"completed_at":"2026-08-16T18:02:25.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.954275] nix-daemon[3692]: accepted connection from pid 4330, user nixbot gitlab # [ 417.955203] nix-daemon[3692]: accepted connection from pid 4338, user nixbot gitlab # [ 417.956177] gitaly[893]: time="2026-08-16T18:02:25.402Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:35.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:25.395" grpc.time_ms=7.22 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.969649] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.321Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"19567e8a5d0ce56381c4d179","created_at":"2026-08-16T18:02:22.072Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-209e159a1bba4f31","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:22.077Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-19567e8a5d0ce56381c4d179: start","job_status":"start","queue_duration_s":3.244178,"scheduling_latency_s":3.244198} gitlab # [ 417.985473] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"19567e8a5d0ce56381c4d179","created_at":"2026-08-16T18:02:22.072Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-209e159a1bba4f31","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:22.077Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-19567e8a5d0ce56381c4d179: done: 0.053764 sec","job_status":"done","queue_duration_s":3.244178,"scheduling_latency_s":3.244198,"redis_calls":19,"redis_duration_s":0.003997,"redis_read_bytes":21,"redis_write_bytes":4289,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000567,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2260,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001896,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00861966,"duration_s":0.053764,"completed_at":"2026-08-16T18:02:25.375Z","load_balancing_strategy":"primary","db_duration_s":0.007047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.032076] nixbot[3477]: {"ts": "2026-08-16T18:02:25.830Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-6908e42eeb28-4", "argv0": "bwrap"} gitlab # [ 418.034714] gitaly[893]: time="2026-08-16T18:02:25.426Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T18:02:35.035" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:25.426" grpc.time_ms=0.553 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.045787] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.377Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0aeb6a33871193aee9733fd2"],"class":"WebHooks::LogExecutionWorker","jid":"0eaffcf2e27ba4930218d830","created_at":"2026-08-16T18:02:23.620Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c28e6681e58347bc","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:06c4845d3f79e06e833a49a3b513975ffc2fca3c5fca6f619d5196fbb39e4412","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:23.633Z","job_size_bytes":2592,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0eaffcf2e27ba4930218d830: start","job_status":"start","queue_duration_s":1.744068,"scheduling_latency_s":1.744087} gitlab # [ 418.062821] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.428Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","0aeb6a33871193aee9733fd2"],"class":"WebHooks::LogExecutionWorker","jid":"0eaffcf2e27ba4930218d830","created_at":"2026-08-16T18:02:23.620Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c28e6681e58347bc","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:06c4845d3f79e06e833a49a3b513975ffc2fca3c5fca6f619d5196fbb39e4412","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:23.633Z","job_size_bytes":2592,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0eaffcf2e27ba4930218d830: done: 0.050881 sec","job_status":"done","queue_duration_s":1.744068,"scheduling_latency_s":1.744087,"redis_calls":10,"redis_duration_s":0.002438,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005823,"duration_s":0.050881,"completed_at":"2026-08-16T18:02:25.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.108090] gitaly[893]: time="2026-08-16T18:02:25.440Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T18:02:35.042" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:25.432" grpc.time_ms=7.653 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.121247] gitaly[893]: time="2026-08-16T18:02:25.497Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:25.496" grpc.time_ms=0.475 pid=893 span.kind=server system=grpc gitlab # [ 418.130838] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.429Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a31e9b57c811931aa203dc7e","created_at":"2026-08-16T18:02:24.363Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-76bf1a0956cb41e8","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:24.368Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a31e9b57c811931aa203dc7e: start","job_status":"start","queue_duration_s":1.061197,"scheduling_latency_s":1.061221} gitlab # [ 418.146545] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.731Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a31e9b57c811931aa203dc7e","created_at":"2026-08-16T18:02:24.363Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-76bf1a0956cb41e8","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:24.368Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3426,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a31e9b57c811931aa203dc7e: rescheduled"} gitlab # [ 418.161659] gitaly[893]: time="2026-08-16T18:02:25.527Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:25.526" grpc.time_ms=0.897 pid=893 span.kind=server system=grpc gitlab # [ 418.171283] gitaly[893]: time="2026-08-16T18:02:25.535Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE diskcache=ce3f9096-20c2-4bdd-80bc-3721469d2a05 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T18:02:35.051" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:25.443" pid=893 ref=refs/keep-around/6908e42eeb287c530a84b8de9235b4e032dd36fd remote_ip="2001:db8:1::1" revision=6908e42eeb287c530a84b8de9235b4e032dd36fd span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd' gitlab # [ 418.182890] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.742Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a31e9b57c811931aa203dc7e","created_at":"2026-08-16T18:02:24.363Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-76bf1a0956cb41e8","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:24.368Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a31e9b57c811931aa203dc7e: done: 0.312875 sec","job_status":"done","queue_duration_s":1.061197,"scheduling_latency_s":1.061221,"gitaly_calls":3,"gitaly_duration_s":0.086911,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016205999999999998,"redis_read_bytes":151,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.00078,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001156,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004206,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006653,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000258,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000305,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002068,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.162064,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.25170802,"duration_s":0.312875,"completed_at":"2026-08-16T18:02:25.742Z","load_balancing_strategy":"primary","db_duration_s":0.056436,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.233555] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.745Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","f7aaa4ebcff25cd66af4128c"],"class":"WebHooks::LogExecutionWorker","jid":"492ae72f27676c18b07f7ee7","created_at":"2026-08-16T18:02:24.719Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-07e50a7e11564424","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:37439d2a171de95ceb3310314e9bcce5908727b9d7904bc76d323a7833645d12","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:24.723Z","job_size_bytes":2592,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-492ae72f27676c18b07f7ee7: start","job_status":"start","queue_duration_s":1.021974,"scheduling_latency_s":1.022007} gitlab # [ 418.250169] gitaly[893]: time="2026-08-16T18:02:25.535Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=78 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5261 command.oublock=8 command.real_time_ms=84 command.spawn_token_fork_ms=3 command.system_time_ms=47 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T18:02:35.051" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T18:02:25.443" grpc.time_ms=92.317 pid=893 ref=refs/keep-around/6908e42eeb287c530a84b8de9235b4e032dd36fd remote_ip="2001:db8:1::1" revision=6908e42eeb287c530a84b8de9235b4e032dd36fd span.kind=server system=grpc username=root gitlab # [ 418.265181] nix-daemon[3692]: accepted connection from pid 4348, user nixbot gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd', in 0.09 seconds) (finished: subtest: push delivers the webhook, in 90.72 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses gitlab # [ 418.266120] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.784Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","f7aaa4ebcff25cd66af4128c"],"class":"WebHooks::LogExecutionWorker","jid":"492ae72f27676c18b07f7ee7","created_at":"2026-08-16T18:02:24.719Z","trace_propagation_headers":{"sentry-trace":"4ffeacf6ab874dcaa1b7108d3e811959-07e50a7e11564424","baggage":"sentry-trace_id=4ffeacf6ab874dcaa1b7108d3e811959,sentry-release=Unknown"},"correlation_id":"01M05VQPMEVQ7E098KC1TKVMG5","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:37439d2a171de95ceb3310314e9bcce5908727b9d7904bc76d323a7833645d12","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:24.723Z","job_size_bytes":2592,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-492ae72f27676c18b07f7ee7: done: 0.039488 sec","job_status":"done","queue_duration_s":1.021974,"scheduling_latency_s":1.022007,"redis_calls":7,"redis_duration_s":0.00178,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039488,"completed_at":"2026-08-16T18:02:25.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.309145] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.786Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6bcfeff5f271e27d7bfe9dc1","created_at":"2026-08-16T18:02:25.360Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c60f1419ef4a4328","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.365Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6bcfeff5f271e27d7bfe9dc1: start","job_status":"start","queue_duration_s":0.420552,"scheduling_latency_s":0.420582} gitlab # [ 418.326273] gitaly[893]: time="2026-08-16T18:02:25.540Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:55.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:25.538" grpc.time_ms=1.15 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.339232] gitaly[893]: time="2026-08-16T18:02:25.540Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:25.540" grpc.time_ms=0.419 pid=893 span.kind=server system=grpc gitlab # [ 418.349139] nixbot[3477]: INFO: ::ffff:127.0.0.1:59840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 200 OK gitlab # [ 418.351062] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6bcfeff5f271e27d7bfe9dc1","created_at":"2026-08-16T18:02:25.360Z","trace_propagation_headers":{"sentry-trace":"5cafc827c4634948bddcaf401a08fd9f-c60f1419ef4a4328","baggage":"sentry-trace_id=5cafc827c4634948bddcaf401a08fd9f,sentry-release=Unknown"},"correlation_id":"01M05VQGZ7MP4AHWSR2FFK1D5E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.365Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6bcfeff5f271e27d7bfe9dc1: done: 0.109675 sec","job_status":"done","queue_duration_s":0.420552,"scheduling_latency_s":0.420582,"redis_calls":11,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00193,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003581,"duration_s":0.109675,"completed_at":"2026-08-16T18:02:25.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.396956] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.897Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9f0f5869f50e8da066269086","created_at":"2026-08-16T18:02:25.507Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.511Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9f0f5869f50e8da066269086: start","job_status":"start","queue_duration_s":0.386129,"scheduling_latency_s":0.386151} gitlab # [ 418.413791] nix-daemon[3692]: accepted connection from pid 4359, user nixbot gitlab # [ 418.414713] nix-daemon[3692]: accepted connection from pid 4369, user nixbot gitlab # [ 418.415623] nix-daemon[3692]: accepted connection from pid 4348, user nixbot gitlab # [ 418.416638] gitaly[893]: time="2026-08-16T18:02:25.563Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:25.563" grpc.time_ms=0.306 pid=893 span.kind=server system=grpc gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses, in 0.14 seconds) gitlab # [ 418.426035] gitaly[893]: time="2026-08-16T18:02:25.585Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:25.584" grpc.time_ms=0.68 pid=893 span.kind=server system=grpc gitlab # [ 418.436691] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9f0f5869f50e8da066269086","created_at":"2026-08-16T18:02:25.507Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.511Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9f0f5869f50e8da066269086: done: 0.079244 sec","job_status":"done","queue_duration_s":0.386129,"scheduling_latency_s":0.386151,"redis_calls":7,"redis_duration_s":0.002758,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079244,"completed_at":"2026-08-16T18:02:25.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011588,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.479288] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:25.978Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4f0b0bf3cd74031b9f9d09f6","created_at":"2026-08-16T18:02:25.541Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-5cec10cfd5c0488d","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.547Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4f0b0bf3cd74031b9f9d09f6: start","job_status":"start","queue_duration_s":0.431827,"scheduling_latency_s":0.431857} gitlab # [ 418.496456] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 104 gitlab # [ 418.499020] gitaly[893]: time="2026-08-16T18:02:25.593Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX diskcache=887a5438-9ab2-43b8-81ca-d3e179bf3cdb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:02:55.516" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:25.516" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.508948] gitaly[893]: time="2026-08-16T18:02:25.593Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7191 command.oublock=0 command.real_time_ms=71 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:02:55.516" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:25.516" grpc.time_ms=76.75 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.522079] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.025Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4f0b0bf3cd74031b9f9d09f6","created_at":"2026-08-16T18:02:25.541Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-5cec10cfd5c0488d","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.547Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4f0b0bf3cd74031b9f9d09f6: done: 0.046405 sec","job_status":"done","queue_duration_s":0.431827,"scheduling_latency_s":0.431857,"redis_calls":7,"redis_duration_s":0.002338,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046405,"completed_at":"2026-08-16T18:02:26.025Z","load_balancing_strategy":"primary","db_duration_s":0.007082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.564812] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.027Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c7a049d9aea56396ebe89145","created_at":"2026-08-16T18:02:25.548Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-5cec10cfd5c0488d","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.551Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c7a049d9aea56396ebe89145: start","job_status":"start","queue_duration_s":0.475175,"scheduling_latency_s":0.475198} gitlab # [ 418.582073] gitaly[893]: time="2026-08-16T18:02:25.656Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:02:55.654" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:25.655" grpc.time_ms=0.903 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.595194] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.091Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c7a049d9aea56396ebe89145","created_at":"2026-08-16T18:02:25.548Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-5cec10cfd5c0488d","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.551Z","job_size_bytes":65,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c7a049d9aea56396ebe89145: done: 0.064366 sec","job_status":"done","queue_duration_s":0.475175,"scheduling_latency_s":0.475198,"redis_calls":10,"redis_duration_s":0.0032920000000000002,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064366,"completed_at":"2026-08-16T18:02:26.091Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.640426] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.094Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0171c2802e17f1c928310179","created_at":"2026-08-16T18:02:25.600Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.603Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0171c2802e17f1c928310179: start","job_status":"start","queue_duration_s":0.491465,"scheduling_latency_s":0.491501} gitlab # [ 418.657229] gitaly[893]: time="2026-08-16T18:02:25.715Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTD17B1875ABGAET7MQHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:55.713" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:25.714" grpc.time_ms=0.833 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.669683] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.157Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0171c2802e17f1c928310179","created_at":"2026-08-16T18:02:25.600Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.603Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0171c2802e17f1c928310179: done: 0.062579 sec","job_status":"done","queue_duration_s":0.491465,"scheduling_latency_s":0.491501,"redis_calls":7,"redis_duration_s":0.002705,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062579,"completed_at":"2026-08-16T18:02:26.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.712110] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.160Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"13756afa4d84180fad800820","created_at":"2026-08-16T18:02:25.611Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.616Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-13756afa4d84180fad800820: start","job_status":"start","queue_duration_s":0.544465,"scheduling_latency_s":0.544554} gitlab # [ 418.727923] gitaly[893]: time="2026-08-16T18:02:26.257Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTF0AEVF0DY8VX6BGS8YB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:56.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:26.256" grpc.time_ms=0.519 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.740894] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.216Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"13756afa4d84180fad800820","created_at":"2026-08-16T18:02:25.611Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.616Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-13756afa4d84180fad800820: done: 0.055422 sec","job_status":"done","queue_duration_s":0.544465,"scheduling_latency_s":0.544554,"redis_calls":7,"redis_duration_s":0.002036,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055422,"completed_at":"2026-08-16T18:02:26.216Z","load_balancing_strategy":"primary","db_duration_s":0.006143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.782824] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.217Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ef6f0b3f7d9b3746a7ffa76d","created_at":"2026-08-16T18:02:25.608Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-5cec10cfd5c0488d","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.616Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ef6f0b3f7d9b3746a7ffa76d: start","job_status":"start","queue_duration_s":0.601546,"scheduling_latency_s":0.601574} gitlab # [ 418.798895] gitaly[893]: time="2026-08-16T18:02:26.308Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:02:56.307" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:26.307" grpc.time_ms=1.046 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.811761] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ef6f0b3f7d9b3746a7ffa76d","created_at":"2026-08-16T18:02:25.608Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-5cec10cfd5c0488d","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.616Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ef6f0b3f7d9b3746a7ffa76d: done: 0.143949 sec","job_status":"done","queue_duration_s":0.601546,"scheduling_latency_s":0.601574,"gitaly_calls":2,"gitaly_duration_s":0.007196,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006787,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000873,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001265,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00028,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001676,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000227,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000593,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105642,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10280832,"duration_s":0.143949,"completed_at":"2026-08-16T18:02:26.361Z","load_balancing_strategy":"primary","db_duration_s":0.026294,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.865143] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2c76cb2181e97b2e269e9c11","created_at":"2026-08-16T18:02:25.624Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.626Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2c76cb2181e97b2e269e9c11: start","job_status":"start","queue_duration_s":0.736869,"scheduling_latency_s":0.736898} gitlab # [ 418.880758] gitaly[893]: time="2026-08-16T18:02:26.349Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTE4WQRP1PK03V51R87HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:56.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:26.347" grpc.time_ms=0.894 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.893153] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2c76cb2181e97b2e269e9c11","created_at":"2026-08-16T18:02:25.624Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.626Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2c76cb2181e97b2e269e9c11: done: 0.037452 sec","job_status":"done","queue_duration_s":0.736869,"scheduling_latency_s":0.736898,"redis_calls":10,"redis_duration_s":0.002871,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000819,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037452,"completed_at":"2026-08-16T18:02:26.400Z","load_balancing_strategy":"primary","db_duration_s":0.008294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.936335] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.402Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ff3985b68f225f0d32c6fc9e","created_at":"2026-08-16T18:02:25.627Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.628Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ff3985b68f225f0d32c6fc9e: start","job_status":"start","queue_duration_s":0.773897,"scheduling_latency_s":0.773923} gitlab # [ 418.952811] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ff3985b68f225f0d32c6fc9e","created_at":"2026-08-16T18:02:25.627Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.628Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ff3985b68f225f0d32c6fc9e: done: 0.031191 sec","job_status":"done","queue_duration_s":0.773897,"scheduling_latency_s":0.773923,"redis_calls":7,"redis_duration_s":0.001974,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001461,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031191,"completed_at":"2026-08-16T18:02:26.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.994928] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.435Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f6291db7d2ea03b2076bb255","created_at":"2026-08-16T18:02:25.629Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.632Z","job_size_bytes":19,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f6291db7d2ea03b2076bb255: start","job_status":"start","queue_duration_s":0.80339,"scheduling_latency_s":0.80341} gitlab # [ 419.010938] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f6291db7d2ea03b2076bb255","created_at":"2026-08-16T18:02:25.629Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.632Z","job_size_bytes":19,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f6291db7d2ea03b2076bb255: done: 0.029284 sec","job_status":"done","queue_duration_s":0.80339,"scheduling_latency_s":0.80341,"redis_calls":8,"redis_duration_s":0.002272,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001758,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029284,"completed_at":"2026-08-16T18:02:26.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.054145] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.466Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"762e7849a4457045eacd3bba","created_at":"2026-08-16T18:02:25.633Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.634Z","job_size_bytes":66,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-762e7849a4457045eacd3bba: start","job_status":"start","queue_duration_s":0.831748,"scheduling_latency_s":0.831768} gitlab # [ 419.071258] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.493Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"762e7849a4457045eacd3bba","created_at":"2026-08-16T18:02:25.633Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.634Z","job_size_bytes":66,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-762e7849a4457045eacd3bba: done: 0.02721 sec","job_status":"done","queue_duration_s":0.831748,"scheduling_latency_s":0.831768,"redis_calls":7,"redis_duration_s":0.0024660000000000003,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02721,"completed_at":"2026-08-16T18:02:26.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.114753] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.495Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"30fffa6f63d07e4148811f76","created_at":"2026-08-16T18:02:25.635Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.636Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-30fffa6f63d07e4148811f76: start","job_status":"start","queue_duration_s":0.858723,"scheduling_latency_s":0.858744} gitlab # [ 419.131157] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.527Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"30fffa6f63d07e4148811f76","created_at":"2026-08-16T18:02:25.635Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.636Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-30fffa6f63d07e4148811f76: done: 0.032104 sec","job_status":"done","queue_duration_s":0.858723,"scheduling_latency_s":0.858744,"redis_calls":7,"redis_duration_s":0.002064,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032104,"completed_at":"2026-08-16T18:02:26.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.173913] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ac36d459d89f33bdc87ff514","created_at":"2026-08-16T18:02:25.637Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.638Z","job_size_bytes":6,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ac36d459d89f33bdc87ff514: start","job_status":"start","queue_duration_s":0.890737,"scheduling_latency_s":0.89076} gitlab # [ 419.189915] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ac36d459d89f33bdc87ff514","created_at":"2026-08-16T18:02:25.637Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.638Z","job_size_bytes":6,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ac36d459d89f33bdc87ff514: done: 0.021744 sec","job_status":"done","queue_duration_s":0.890737,"scheduling_latency_s":0.89076,"redis_calls":7,"redis_duration_s":0.002575,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021744,"completed_at":"2026-08-16T18:02:26.551Z","load_balancing_strategy":"primary","db_duration_s":0.000788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.231706] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.555Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"eb833fd68e3346ee736cb408","created_at":"2026-08-16T18:02:25.639Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.641Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-eb833fd68e3346ee736cb408: start","job_status":"start","queue_duration_s":0.914284,"scheduling_latency_s":0.914331} gitlab # [ 419.247141] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"eb833fd68e3346ee736cb408","created_at":"2026-08-16T18:02:25.639Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.641Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-eb833fd68e3346ee736cb408: done: 0.048512 sec","job_status":"done","queue_duration_s":0.914284,"scheduling_latency_s":0.914331,"redis_calls":7,"redis_duration_s":0.003005,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048512,"completed_at":"2026-08-16T18:02:26.603Z","load_balancing_strategy":"primary","db_duration_s":0.007115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.290267] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.605Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f1e264f64410870155b1873f","created_at":"2026-08-16T18:02:25.731Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.735Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f1e264f64410870155b1873f: start","job_status":"start","queue_duration_s":0.870926,"scheduling_latency_s":0.870955} gitlab # [ 419.305976] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.670Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f1e264f64410870155b1873f","created_at":"2026-08-16T18:02:25.731Z","trace_propagation_headers":{"sentry-trace":"6790126d44cf426aa5195b73319ef780-e4d7a635dc5244ee","baggage":"sentry-trace_id=6790126d44cf426aa5195b73319ef780,sentry-release=Unknown"},"correlation_id":"01M05VTD17B1875ABGAET7MQHX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:25.735Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f1e264f64410870155b1873f: done: 0.064701 sec","job_status":"done","queue_duration_s":0.870926,"scheduling_latency_s":0.870955,"redis_calls":8,"redis_duration_s":0.004246,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003527,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064701,"completed_at":"2026-08-16T18:02:26.670Z","load_balancing_strategy":"primary","db_duration_s":0.008075,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 419.347580] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8527346eed5d3c72c14e58ff","created_at":"2026-08-16T18:02:26.288Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-a1825d1a11d04c46","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:26.291Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8527346eed5d3c72c14e58ff: start","job_status":"start","queue_duration_s":0.382715,"scheduling_latency_s":0.38276} gitlab # [ 419.364279] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:26.743Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8527346eed5d3c72c14e58ff","created_at":"2026-08-16T18:02:26.288Z","trace_propagation_headers":{"sentry-trace":"d8135ab3ce2a4b419d439df9aeb39ed3-a1825d1a11d04c46","baggage":"sentry-trace_id=d8135ab3ce2a4b419d439df9aeb39ed3,sentry-release=Unknown"},"correlation_id":"01M05VTE4WQRP1PK03V51R87HE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:26.291Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8527346eed5d3c72c14e58ff: done: 0.070308 sec","job_status":"done","queue_duration_s":0.382715,"scheduling_latency_s":0.38276,"redis_calls":7,"redis_duration_s":0.002733,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001957,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070308,"completed_at":"2026-08-16T18:02:26.743Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses gitlab # [ 419.630281] gitaly[893]: time="2026-08-16T18:02:27.495Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTG5R3NK2DY7W64DPHZS0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:57.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:27.493" grpc.time_ms=1.345 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses, in 0.27 seconds) gitlab # [ 419.703410] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 183 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses gitlab # [ 420.860581] gitaly[893]: time="2026-08-16T18:02:28.725Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTHCGQZ1EN6B133GXR10V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:58.723" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:28.723" grpc.time_ms=1.341 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.916312] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 156 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses, in 0.22 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses gitlab # [ 422.064276] gitaly[893]: time="2026-08-16T18:02:29.929Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTJJFBYB7JW57B21EGQQQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:02:59.026" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:29.927" grpc.time_ms=1.318 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses, in 0.20 seconds) gitlab # [ 422.120899] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 146 gitlab # [ 422.696431] gitaly[893]: time="2026-08-16T18:02:30.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:00.559" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:30.560" grpc.time_ms=1.279 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.786949] gitaly[893]: time="2026-08-16T18:02:30.652Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:40.134" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:30.634" grpc.time_ms=18.035 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.866375] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:30.730Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d8ee654e84aafd2265d98089","created_at":"2026-08-16T18:02:30.720Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-9480d8fb306c4af7","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:30.727Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d8ee654e84aafd2265d98089: start","job_status":"start","queue_duration_s":0.002719,"scheduling_latency_s":0.002787} gitlab # [ 422.913780] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 319 gitlab # [ 422.921015] nixbot[3477]: {"ts": "2026-08-16T18:02:30.763Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd \"HTTP/1.1 201 Created\""} gitlab # [ 423.023185] gitaly[893]: time="2026-08-16T18:02:30.889Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTKFMCG6TR11T1829AMAN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:00.886" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:30.887" grpc.time_ms=1.225 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses gitlab # [ 423.162319] gitaly[893]: time="2026-08-16T18:02:31.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTKFMCG6TR11T1829AMAN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:40.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.000" grpc.time_ms=26.195 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.249554] gitaly[893]: time="2026-08-16T18:02:31.115Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:31.114" grpc.time_ms=0.951 pid=893 span.kind=server system=grpc gitlab # [ 423.277572] gitaly[893]: time="2026-08-16T18:02:31.140Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTKRJ9YV0BQTMA7R6GR5J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:01.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:31.138" grpc.time_ms=1.066 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.304215] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 384 gitlab # [ 423.308819] nixbot[3477]: {"ts": "2026-08-16T18:02:31.158Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd \"HTTP/1.1 201 Created\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses, in 0.19 seconds) gitlab # [ 423.314183] gitaly[893]: time="2026-08-16T18:02:31.171Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:31.170" grpc.time_ms=1.105 pid=893 span.kind=server system=grpc gitlab # [ 423.332215] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 119 gitlab # [ 423.338745] gitaly[893]: time="2026-08-16T18:02:31.204Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:31.204" grpc.time_ms=0.741 pid=893 span.kind=server system=grpc gitlab # [ 423.357356] gitaly[893]: time="2026-08-16T18:02:31.210Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.074" operations="[repack_refs]" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.372836] gitaly[893]: time="2026-08-16T18:02:31.214Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.074" pid=893 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 18:00:47.52331494 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 423.388825] gitaly[893]: time="2026-08-16T18:02:31.216Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK diskcache=255a87dc-3a21-4d12-9ba3-cb6f3c6671d8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.074" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.401015] gitaly[893]: time="2026-08-16T18:02:31.217Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7063 command.oublock=0 command.real_time_ms=134 command.spawn_token_fork_ms=1 command.system_time_ms=46 command.user_time_ms=67 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.074" grpc.time_ms=142.406 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.416978] gitaly[893]: time="2026-08-16T18:02:31.238Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTKW2NB5V06K6XD1J9RWP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:01.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:31.237" grpc.time_ms=0.414 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.430526] gitaly[893]: time="2026-08-16T18:02:31.244Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.074" pid=893 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 423.444420] gitaly[893]: time="2026-08-16T18:02:31.244Z" level=info msg="optimized repository" clean_stale_data_time=29.39554ms clean_work_trees_time="127.22µs" commit_graph_time=660ns correlation_id=01M05VTK58P5GF0J9Q49MQT0PK gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.52µs" pid=893 prune_time=280ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.54µs" storage_name=default system=housekeeping total_time=29.5518ms gitlab # [ 423.450245] gitaly[893]: time="2026-08-16T18:02:31.244Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:01.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.074" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.459564] gitaly[893]: time="2026-08-16T18:02:31.277Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05VTKW2NB5V06K6XD1J9RWP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T18:02:41.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:31.270" grpc.time_ms=7.429 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.472927] gitaly[893]: time="2026-08-16T18:02:31.313Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:03:01.312" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:31.312" grpc.time_ms=0.916 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.489142] gitaly[893]: time="2026-08-16T18:02:31.355Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:01.354" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:31.354" grpc.time_ms=0.501 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.508483] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.364Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d814dff7ca761aa3baf1f5","created_at":"2026-08-16T18:02:31.363Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"d8ee654e84aafd2265d98089","job_size_bytes":3,"pid":3426,"job_status":"deduplicated","message":"PipelineProcessWorker JID-b5d814dff7ca761aa3baf1f5: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 423.530169] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.367Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d8ee654e84aafd2265d98089","created_at":"2026-08-16T18:02:30.720Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-9480d8fb306c4af7","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:30.727Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3426,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d8ee654e84aafd2265d98089: rescheduled"} gitlab # [ 423.550756] nixbot[3477]: {"ts": "2026-08-16T18:02:31.373Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd \"HTTP/1.1 201 Created\""} gitlab # [ 423.554256] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6908e42eeb287c530a84b8de9235b4e032dd36fd HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 205 gitlab # [ 423.557327] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.373Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d8ee654e84aafd2265d98089","created_at":"2026-08-16T18:02:30.720Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-9480d8fb306c4af7","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:30.727Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d8ee654e84aafd2265d98089: done: 0.643347 sec","job_status":"done","queue_duration_s":0.002719,"scheduling_latency_s":0.002787,"gitaly_calls":3,"gitaly_duration_s":0.152518,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025737,"redis_read_bytes":239,"redis_write_bytes":21785,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001767,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002614,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.005672,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.010431,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00043,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000859,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002197,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":17,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.398967,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.56075304,"duration_s":0.643347,"completed_at":"2026-08-16T18:02:31.373Z","load_balancing_strategy":"primary","db_duration_s":0.075323,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.609921] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"eb1e7ca17c27865db17121f9","created_at":"2026-08-16T18:02:31.058Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.063Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-eb1e7ca17c27865db17121f9: start","job_status":"start","queue_duration_s":0.311591,"scheduling_latency_s":0.311615} gitlab # [ 423.626466] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"eb1e7ca17c27865db17121f9","created_at":"2026-08-16T18:02:31.058Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.063Z","job_size_bytes":23,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-eb1e7ca17c27865db17121f9: done: 0.052144 sec","job_status":"done","queue_duration_s":0.311591,"scheduling_latency_s":0.311615,"redis_calls":7,"redis_duration_s":0.0029490000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052144,"completed_at":"2026-08-16T18:02:31.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012499,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.669421] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.429Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"55aa0f751cbc1977f8a10b42","created_at":"2026-08-16T18:02:31.225Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.230Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-55aa0f751cbc1977f8a10b42: start","job_status":"start","queue_duration_s":0.198911,"scheduling_latency_s":0.198932} gitlab # [ 423.686454] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.465Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"55aa0f751cbc1977f8a10b42","created_at":"2026-08-16T18:02:31.225Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.230Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-55aa0f751cbc1977f8a10b42: done: 0.03656 sec","job_status":"done","queue_duration_s":0.198911,"scheduling_latency_s":0.198932,"redis_calls":7,"redis_duration_s":0.001741,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03656,"completed_at":"2026-08-16T18:02:31.465Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.730790] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"68bddf96bc3100f4e364f4be","created_at":"2026-08-16T18:02:31.250Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.254Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-68bddf96bc3100f4e364f4be: start","job_status":"start","queue_duration_s":0.212838,"scheduling_latency_s":0.212861} gitlab # [ 423.748406] nix-daemon[3692]: accepted connection from pid 4452, user nixbot gitlab # [ 423.749378] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.505Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"68bddf96bc3100f4e364f4be","created_at":"2026-08-16T18:02:31.250Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.254Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-68bddf96bc3100f4e364f4be: done: 0.037787 sec","job_status":"done","queue_duration_s":0.212838,"scheduling_latency_s":0.212861,"redis_calls":7,"redis_duration_s":0.002431,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000608,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037787,"completed_at":"2026-08-16T18:02:31.505Z","load_balancing_strategy":"primary","db_duration_s":0.00875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.791426] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.508Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"8d10ab4b9c00370375419a65","created_at":"2026-08-16T18:02:31.267Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.270Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8d10ab4b9c00370375419a65: start","job_status":"start","queue_duration_s":0.237278,"scheduling_latency_s":0.237302} gitlab # [ 423.807302] gitaly[893]: time="2026-08-16T18:02:31.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05VTM8BPGB2A4JXSZRK18YW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:31.620" grpc.time_ms=9.01 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 423.820548] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 66 gitlab # [ 423.822595] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"8d10ab4b9c00370375419a65","created_at":"2026-08-16T18:02:31.267Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.270Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8d10ab4b9c00370375419a65: done: 0.061739 sec","job_status":"done","queue_duration_s":0.237278,"scheduling_latency_s":0.237302,"redis_calls":10,"redis_duration_s":0.0029879999999999998,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000978,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061739,"completed_at":"2026-08-16T18:02:31.569Z","load_balancing_strategy":"primary","db_duration_s":0.01547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.866630] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0f3ccb56918c4c61e2ff29a1","created_at":"2026-08-16T18:02:31.271Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.274Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0f3ccb56918c4c61e2ff29a1: start","job_status":"start","queue_duration_s":0.299557,"scheduling_latency_s":0.299594} gitlab # [ 423.883457] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0f3ccb56918c4c61e2ff29a1","created_at":"2026-08-16T18:02:31.271Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.274Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0f3ccb56918c4c61e2ff29a1: done: 0.048682 sec","job_status":"done","queue_duration_s":0.299557,"scheduling_latency_s":0.299594,"redis_calls":7,"redis_duration_s":0.0027270000000000003,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048682,"completed_at":"2026-08-16T18:02:31.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.926743] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.624Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"523692f70e3e48c0c0f3b19f","created_at":"2026-08-16T18:02:31.275Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.279Z","job_size_bytes":19,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-523692f70e3e48c0c0f3b19f: start","job_status":"start","queue_duration_s":0.345376,"scheduling_latency_s":0.345406} gitlab # [ 423.942974] gitlab-workhorse[819]: time="2026-08-16T18:02:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 423.946037] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 69 gitlab # [ 423.947914] gitaly[893]: time="2026-08-16T18:02:31.699Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTMAGC9EVH9C5BWQG4E82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:31.687" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 423.958372] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.668Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"523692f70e3e48c0c0f3b19f","created_at":"2026-08-16T18:02:31.275Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.279Z","job_size_bytes":19,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-523692f70e3e48c0c0f3b19f: done: 0.043173 sec","job_status":"done","queue_duration_s":0.345376,"scheduling_latency_s":0.345406,"redis_calls":8,"redis_duration_s":0.004691,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002358,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002333,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043173,"completed_at":"2026-08-16T18:02:31.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.001675] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.670Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5ebfc94f1f6eeed3206d4580","created_at":"2026-08-16T18:02:31.280Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.283Z","job_size_bytes":66,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5ebfc94f1f6eeed3206d4580: start","job_status":"start","queue_duration_s":0.387266,"scheduling_latency_s":0.387294} gitlab # [ 424.019123] nix-daemon[3692]: accepted connection from pid 4477, user nixbot gitlab # [ 424.020136] gitaly[893]: time="2026-08-16T18:02:31.699Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTMAGC9EVH9C5BWQG4E82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:31.687" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 424.033504] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.701Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5ebfc94f1f6eeed3206d4580","created_at":"2026-08-16T18:02:31.280Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.283Z","job_size_bytes":66,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5ebfc94f1f6eeed3206d4580: done: 0.030995 sec","job_status":"done","queue_duration_s":0.387266,"scheduling_latency_s":0.387294,"redis_calls":7,"redis_duration_s":0.002023,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001454,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030995,"completed_at":"2026-08-16T18:02:31.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.076559] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.705Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f56bd4d3511a498abfbfb98d","created_at":"2026-08-16T18:02:31.285Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.287Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f56bd4d3511a498abfbfb98d: start","job_status":"start","queue_duration_s":0.417178,"scheduling_latency_s":0.417204} gitlab # [ 424.092664] gitaly[893]: time="2026-08-16T18:02:31.700Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTMAGC9EVH9C5BWQG4E82 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T18:02:31.687" grpc.time_ms=12.597 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 424.106950] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.760Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f56bd4d3511a498abfbfb98d","created_at":"2026-08-16T18:02:31.285Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.287Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f56bd4d3511a498abfbfb98d: done: 0.055429 sec","job_status":"done","queue_duration_s":0.417178,"scheduling_latency_s":0.417204,"redis_calls":7,"redis_duration_s":0.002637,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055429,"completed_at":"2026-08-16T18:02:31.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.150247] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.764Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"e1cf9340c83a4517da62a888","created_at":"2026-08-16T18:02:31.292Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.294Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e1cf9340c83a4517da62a888: start","job_status":"start","queue_duration_s":0.469172,"scheduling_latency_s":0.469222} gitlab # [ 424.166617] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.826Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"e1cf9340c83a4517da62a888","created_at":"2026-08-16T18:02:31.292Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.294Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e1cf9340c83a4517da62a888: done: 0.062335 sec","job_status":"done","queue_duration_s":0.469172,"scheduling_latency_s":0.469222,"redis_calls":7,"redis_duration_s":0.003062,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062335,"completed_at":"2026-08-16T18:02:31.826Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.208798] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8c64d2b39b51b8b2bc9faeec","created_at":"2026-08-16T18:02:31.295Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.297Z","job_size_bytes":6,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8c64d2b39b51b8b2bc9faeec: start","job_status":"start","queue_duration_s":0.534939,"scheduling_latency_s":0.534984} gitlab # [ 424.224416] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.863Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8c64d2b39b51b8b2bc9faeec","created_at":"2026-08-16T18:02:31.295Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.297Z","job_size_bytes":6,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8c64d2b39b51b8b2bc9faeec: done: 0.030724 sec","job_status":"done","queue_duration_s":0.534939,"scheduling_latency_s":0.534984,"redis_calls":7,"redis_duration_s":0.0022170000000000002,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030724,"completed_at":"2026-08-16T18:02:31.863Z","load_balancing_strategy":"primary","db_duration_s":0.000541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.266155] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"179e381d1a65709699310d6f","created_at":"2026-08-16T18:02:31.298Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.301Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-179e381d1a65709699310d6f: start","job_status":"start","queue_duration_s":0.564344,"scheduling_latency_s":0.564401} gitlab # [ 424.281929] gitaly[893]: time="2026-08-16T18:02:32.078Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:32.077" grpc.time_ms=0.879 pid=893 span.kind=server system=grpc gitlab # [ 424.291679] gitaly[893]: time="2026-08-16T18:02:32.125Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:32.124" grpc.time_ms=0.871 pid=893 span.kind=server system=grpc gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses gitlab # [ 424.301340] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"179e381d1a65709699310d6f","created_at":"2026-08-16T18:02:31.298Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.301Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-179e381d1a65709699310d6f: done: 0.043659 sec","job_status":"done","queue_duration_s":0.564344,"scheduling_latency_s":0.564401,"redis_calls":7,"redis_duration_s":0.002371,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043659,"completed_at":"2026-08-16T18:02:31.909Z","load_balancing_strategy":"primary","db_duration_s":0.006062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.341200] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:31.912Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"955c4cf2ba84f09464ae5fe1","created_at":"2026-08-16T18:02:31.367Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.369Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-955c4cf2ba84f09464ae5fe1: start","job_status":"start","queue_duration_s":0.542871,"scheduling_latency_s":0.542905} gitlab # [ 424.356380] gitaly[893]: time="2026-08-16T18:02:32.177Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T18:02:32.176" grpc.time_ms=0.85 pid=893 span.kind=server system=grpc gitlab # [ 424.366320] gitaly[893]: time="2026-08-16T18:02:32.193Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK diskcache=ce6808fd-6db9-4c3b-8498-54dcdf571125 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:02.021" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:32.022" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.376679] gitaly[893]: time="2026-08-16T18:02:32.194Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=182 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7090 command.oublock=0 command.real_time_ms=164 command.spawn_token_fork_ms=1 command.system_time_ms=108 command.user_time_ms=74 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T18:03:02.021" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T18:02:32.022" grpc.time_ms=171.577 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.458808] gitaly[893]: time="2026-08-16T18:02:32.324Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T18:03:02.322" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:32.323" grpc.time_ms=1.52 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.504754] gitaly[893]: time="2026-08-16T18:02:32.370Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTMYWJVCDKD3YP39HH969 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:02.168" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:32.369" grpc.time_ms=1.262 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.538535] gitaly[893]: time="2026-08-16T18:02:32.404Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05VTK58P5GF0J9Q49MQT0PK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T18:03:02.402" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T18:02:32.403" grpc.time_ms=1.252 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.571818] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/16:18:02:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 152 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6908e42eeb287c530a84b8de9235b4e032dd36fd/statuses, in 0.26 seconds) (finished: subtest: eval and build post commit statuses, in 6.29 seconds) (finished: run the VM test script, in 497.05 seconds) test script finished in 497.09s cleanup kill QemuMachine (pid 46) gitlab # [ 424.594035] sidekiq-cluster[3426]: {"severity":"INFO","time":"2026-08-16T18:02:32.458Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"955c4cf2ba84f09464ae5fe1","created_at":"2026-08-16T18:02:31.367Z","trace_propagation_headers":{"sentry-trace":"0c3654179bfd442aa4f3fd9a52483ffd-69c108dff47b4d24","baggage":"sentry-trace_id=0c3654179bfd442aa4f3fd9a52483ffd,sentry-release=Unknown"},"correlation_id":"01M05VTK58P5GF0J9Q49MQT0PK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T18:02:31.369Z","job_size_bytes":3,"pid":3426,"sidekiq_tid":"m8m6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-955c4cf2ba84f09464ae5fe1: done: 0.546734 sec","job_status":"done","queue_duration_s":0.542871,"scheduling_latency_s":0.542905,"gitaly_calls":3,"gitaly_duration_s":0.206972,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.026498,"redis_read_bytes":144,"redis_write_bytes":16877,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000779,"redis_action_cable_read_bytes":2,"reqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.34 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T18:00:54.927Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T18:02:25.301757Z', 'started_at': '2026-08-16T18:02:25.645628Z', 'finished_at': None}] [{'id': 5, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T18:02:25.598Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T18:02:25.598Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T18:02:25.598Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T18:02:25.598Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T18:02:25.598Z', 'started_at': None, 'finished_at': '2026-08-16T18:02:30.701Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-16T18:02:31.109Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T18:02:25.598Z', 'started_at': None, 'finished_at': '2026-08-16T18:02:30.701Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '6908e42eeb287c530a84b8de9235b4e032dd36fd', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-16T18:02:31.109Z', 'started_at': None, 'finished_at': '2026-08-16T18:02:31.298Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]