tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab: QEMU running (pid 46) gitlab # Formatting '/build/vm-state-gitlab/tmp.u1yARY1pQI', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes (finished: start all VMs, in 71.75 seconds) gitlab # Filesystem UUID: 2740c36f-3aa7-45d9-9870-457e8fbc53c4 gitlab: waiting for unit setup-gitlab.service gitlab # Superblock backups stored on blocks: gitlab: waiting for the VM to finish booting gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/a0qymq3jxbls8bajr4rh0r0i8xcbpbba-nixos-system-gitlab-test/init regInfo=/nix/store/hhgv7fa5js1fmyd8zxh2h67qgrbwckdr-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hhgv7fa5js1fmyd8zxh2h67qgrbwckdr-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f40000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000029] arm-pv: using stolen time PV gitlab # [ 0.000373] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000562] Console: colour dummy device 80x25 gitlab # [ 0.000569] printk: legacy console [tty0] enabled gitlab # [ 0.000752] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000759] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000839] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000972] landlock: Up and running. gitlab # [ 0.000975] Yama: becoming mindful. gitlab # [ 0.001422] LSM support for eBPF active gitlab # [ 0.001626] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001731] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002800] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003487] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003491] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.004038] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.005014] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.005106] EFI services will not be available. gitlab # [ 0.005267] smp: Bringing up secondary CPUs ... gitlab # [ 0.005915] Detected PIPT I-cache on CPU1 gitlab # [ 0.006012] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.006135] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.006260] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007349] Detected PIPT I-cache on CPU2 gitlab # [ 0.007455] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007579] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.007703] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008732] Detected PIPT I-cache on CPU3 gitlab # [ 0.008848] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008969] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000 gitlab # [ 0.009093] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009619] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009646] SMP: Total of 4 processors activated. gitlab # [ 0.009649] CPU: All CPU(s) started at EL1 gitlab # [ 0.009659] CPU features: detected: Branch Target Identification gitlab # [ 0.009663] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009666] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009669] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009672] CPU features: detected: Common not Private translations gitlab # [ 0.009675] CPU features: detected: CRC32 instructions gitlab # [ 0.009678] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009681] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009684] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009686] CPU features: detected: E0PD gitlab # [ 0.009689] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009692] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009694] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009697] CPU features: detected: Fine Grained Traps gitlab # [ 0.009700] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009705] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009707] CPU features: detected: LSE atomic instructions gitlab # [ 0.009710] CPU features: detected: Privileged Access Never gitlab # [ 0.009712] CPU features: detected: PMUv3 gitlab # [ 0.009715] CPU features: detected: RAS Extension Support gitlab # [ 0.009718] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009720] CPU features: detected: Random Number Generator gitlab # [ 0.009722] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009725] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009727] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009731] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009857] alternatives: applying system-wide alternatives gitlab # [ 0.012802] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.013063] Memory: 5963760K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014534] devtmpfs: initialized gitlab # [ 0.018419] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018484] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018682] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018686] 0 pages in range for non-PLT usage gitlab # [ 0.018688] 508288 pages in range for PLT usage gitlab # [ 0.018805] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019622] DMI not present or invalid. gitlab # [ 0.022712] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.025072] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025357] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027459] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027481] audit: initializing netlink subsys (disabled) gitlab # [ 0.027776] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.028256] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.028259] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.028264] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.028266] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.028269] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028351] cpuidle: using governor ladder gitlab # [ 0.028374] cpuidle: using governor menu gitlab # [ 0.028565] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.028774] ASID allocator initialised with 65536 entries gitlab # [ 0.029907] Serial: AMBA PL011 UART driver gitlab # [ 0.035051] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.035347] printk: console [ttyAMA0] enabled gitlab # [ 0.047712] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.047735] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.047744] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.047753] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.047761] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.047769] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.047778] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.047785] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059366] fbcon: Taking over console gitlab # [ 0.059377] ACPI: Interpreter disabled. gitlab # [ 0.060389] iommu: Default domain type: Translated gitlab # [ 0.060405] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.070085] SCSI subsystem initialized gitlab # [ 0.070517] usbcore: registered new interface driver usbfs gitlab # [ 0.070543] usbcore: registered new interface driver hub gitlab # [ 0.070560] usbcore: registered new device driver usb gitlab # [ 0.070853] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.070857] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.070867] PTP clock support registered gitlab # [ 0.070908] EDAC MC: Ver: 3.0.0 gitlab # [ 0.071381] scmi_core: SCMI protocol bus registered gitlab # [ 0.072677] FPGA manager framework gitlab # [ 0.073541] vgaarb: loaded gitlab # [ 0.074980] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.094535] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.094605] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.095570] netfs: FS-Cache loaded gitlab # [ 0.095876] pnp: PnP ACPI: disabled gitlab # [ 0.106645] NET: Registered PF_INET protocol family gitlab # [ 0.109433] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.170071] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.170146] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.170209] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.170632] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.171593] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.171791] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.171886] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.172073] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.172396] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.172474] NET: Registered PF_XDP protocol family gitlab # [ 0.172498] PCI: CLS 0 bytes, default 64 gitlab # [ 0.172852] Trying to unpack rootfs image as initramfs... gitlab # [ 0.187814] kvm [1]: HYP mode not available gitlab # [ 0.265082] Initialise system trusted keyrings gitlab # [ 0.265407] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.266184] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.266372] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.281712] Key type asymmetric registered gitlab # [ 0.281725] Asymmetric key parser 'x509' registered gitlab # [ 0.281781] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.282129] io scheduler mq-deadline registered gitlab # [ 0.282137] io scheduler kyber registered gitlab # [ 0.288100] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.291661] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.292258] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.292279] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.292294] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.292304] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.292333] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.292365] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.292537] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.292548] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.292569] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.292575] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.292580] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.292720] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.293522] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.293851] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.293871] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.293915] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.293936] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.294788] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.295158] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.295178] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.295222] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.296110] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.296436] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.296456] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.296501] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.297374] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.297700] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.297719] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.297769] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.298586] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.298906] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.298925] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.298976] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.299851] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.300214] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.300232] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.300284] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.301122] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.301453] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.301480] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.301529] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.301549] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.302428] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.302771] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.302812] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.303654] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.303988] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.304030] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.304740] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.305064] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.305488] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.305897] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.305916] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.305965] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.306792] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.307143] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.307162] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.307212] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.308276] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.308286] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.308292] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.308370] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.308446] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.308514] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.308584] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.308665] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.308747] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.308825] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.308905] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.308988] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.309079] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.309148] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.309176] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.309205] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.309233] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.309262] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.309300] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.309329] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.309364] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.309399] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.309429] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.309458] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.309497] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.309525] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.309553] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.309582] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.309616] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.309645] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.309674] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.309702] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.309739] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.309768] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.309804] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.309812] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.309817] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.312004] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.328772] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.331767] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.334494] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.337437] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.343415] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.346122] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.348831] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.351749] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.357894] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.360500] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.363829] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.371649] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.374133] msm_serial: driver initialized gitlab # [ 0.374346] SuperH (H)SCI(F) driver initialized gitlab # [ 0.374409] STM32 USART driver initialized gitlab # [ 0.404764] loop: module loaded gitlab # [ 0.405003] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.407340] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.409612] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.411715] virtio_blk virtio5: [vdb] 12204312 512-byte logical blocks (6.25 GB/5.82 GiB) gitlab # [ 0.414368] megasas: 07.734.00.00-rc1 gitlab # [ 0.415253] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.417685] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.417711] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.419868] Using buffer write method gitlab # [ 0.419911] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.422258] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.422280] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.424503] Using buffer write method gitlab # [ 0.424524] Concatenating MTD devices: gitlab # [ 0.424527] (0): "0.flash" gitlab # [ 0.424530] (1): "0.flash" gitlab # [ 0.424532] into device "0.flash" gitlab # [ 0.695270] Freeing initrd memory: 27184K gitlab # [ 0.713926] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.721483] thunder_xcv, ver 1.0 gitlab # [ 0.721578] thunder_bgx, ver 1.0 gitlab # [ 0.721630] nicpf, ver 1.0 gitlab # [ 0.723173] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.723185] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.723255] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.723269] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.723333] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.723341] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.723395] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.723404] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.723763] sky2: driver version 1.30 gitlab # [ 0.728209] usbcore: registered new interface driver usb-storage gitlab # [ 0.728470] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.728514] usbserial: USB Serial support registered for generic gitlab # [ 0.728839] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.728894] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.729641] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.730177] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.732653] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.732740] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T08:48:41 UTC (1787215721) gitlab # [ 0.733762] i2c_dev: i2c /dev entries driver gitlab # [ 0.739093] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.740111] hub 1-0:1.0: USB hub found gitlab # [ 0.740167] hub 1-0:1.0: 6 ports detected gitlab # [ 0.742012] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.742028] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.742843] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.743978] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.748804] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.749777] usbcore: registered new interface driver usbhid gitlab # [ 0.749790] usbhid: USB HID core driver gitlab # [ 0.761356] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.766103] drop_monitor: Initializing network drop monitor service gitlab # [ 0.766513] NET: Registered PF_INET6 protocol family gitlab # [ 0.768090] Segment Routing with IPv6 gitlab # [ 0.768124] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.768245] NET: Registered PF_PACKET protocol family gitlab # [ 0.768588] 9pnet: Installing 9P2000 support gitlab # [ 0.773162] Key type dns_resolver registered gitlab # [ 0.792234] registered taskstats version 1 gitlab # [ 0.792746] Loading compiled-in X.509 certificates gitlab # [ 0.815691] Demotion targets for Node 0: null gitlab # [ 0.815970] Key type .fscrypt registered gitlab # [ 0.815978] Key type fscrypt-provisioning registered gitlab # [ 0.816167] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.816191] ima: Allocated hash algorithm: sha1 gitlab # [ 0.816221] ima: No architecture policies found gitlab # [ 0.817615] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.850017] clk: Disabling unused clocks gitlab # [ 0.850067] PM: genpd: Disabling unused power domains gitlab # [ 0.858879] Freeing unused kernel memory: 4736K gitlab # [ 0.859212] Run /init as init process gitlab # [ 0.905764] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.987053] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.141458] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.227749] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.240650] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.240718] systemd[1]: Detected virtualization qemu. gitlab # [ 1.240790] systemd[1]: Detected architecture arm64. gitlab # [ 1.240807] systemd[1]: Running in initrd. gitlab # [ 1.241665] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.242028] systemd[1]: Hostname set to . gitlab # [ 1.347056] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.483951] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.503638] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.504304] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.558646] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.581149] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.581756] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.581832] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.581860] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.581910] systemd[1]: Reached target Path Units. gitlab # [ 1.581945] systemd[1]: Reached target Slice Units. gitlab # [ 1.581982] systemd[1]: Reached target Swaps. gitlab # [ 1.582020] systemd[1]: Reached target Timer Units. gitlab # [ 1.582422] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.582751] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.583098] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.583391] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.583615] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.583659] systemd[1]: Reached target Socket Units. gitlab # [ 1.586945] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.590200] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.590333] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.595287] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.607182] systemd[1]: Starting Journal Service... gitlab # [ 1.612047] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.612334] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.628659] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.632450] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.634557] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.635391] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.635956] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.638830] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.658675] systemd-journald[96]: Collecting audit messages is disabled. gitlab # [ 1.661507] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.661823] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.661829] [drm] features: -context_init gitlab # [ 1.664694] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.667219] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.677417] [drm] number of scanouts: 1 gitlab # [ 1.677469] [drm] number of cap sets: 0 gitlab # [ 1.677981] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.681114] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.683265] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.683308] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.692958] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.693497] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.693525] systemd[1]: Reached target Local File Systems. gitlab # [ 1.695614] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.701999] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.704991] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.723514] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.727180] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.745441] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.752589] systemd[1]: Started Journal Service. gitlab # [ 1.751388] systemd-modules-load[97]: Using 4 probe threads gitlab # [ 1.752963] systemd-modules-load[97]: Module 'virtio_balloon' is built in gitlab # [ 1.754306] systemd-modules-load[97]: Module 'virtio_console' is built in gitlab # [ 1.756287] systemd-modules-load[97]: Module 'virtio_rng' is built in gitlab # [ 1.758381] systemd-modules-load[97]: Inserted module 'dm_mod' gitlab # [ 1.759517] systemd-modules-load[97]: Inserted module 'virtio_gpu' gitlab # [ 1.761680] systemd-udevd[105]: Using default interface naming scheme 'v261'. gitlab # [ 1.764444] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.765662] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.777895] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.784635] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.808723] systemd-vconsole-setup[132]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.811183] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.245259] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.247889] systemd[1]: Reached target System Initialization. gitlab # [ 2.250555] systemd[1]: Reached target Basic System. gitlab # [ 2.460528] (udev-worker)[119]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.464740] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.496096] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.501457] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.504597] (udev-worker)[116]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.506779] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.521864] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.552598] systemd-fsck[155]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.555029] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.630105] systemd[1]: Mounting /sysroot... gitlab # [ 2.672630] EXT4-fs (vda): mounted filesystem 2740c36f-3aa7-45d9-9870-457e8fbc53c4 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.671916] systemd[1]: Mounted /sysroot. gitlab # [ 2.676072] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.678580] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.681647] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.700144] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.706098] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.709574] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.732245] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.732986] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.735759] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.737692] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.739310] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.740707] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.742137] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.744419] systemd-sysroot-fstab-check[169]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.749771] systemd[1]: Reload requested from client PID 169 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.751975] systemd[1]: Reloading... gitlab # [ 2.851864] systemd[1]: Reloading finished in 100 ms. gitlab # [ 2.895398] systemd-sysroot-fstab-check[169]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.898128] systemd-sysroot-fstab-check[169]: Requesting swap.target/start/replace... gitlab # [ 2.900680] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.901796] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.903190] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.904584] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.923600] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.925978] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.029107] (udev-worker)[137]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.032255] (udev-worker)[137]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.039925] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.041190] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.041941] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.042723] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.087114] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.089393] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.635034] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.714394] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.716704] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.719072] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.721446] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.770663] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.774341] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.787488] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.789942] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.792466] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.843984] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.846571] systemd[1]: Stopped target Basic System. gitlab # [ 3.848837] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.851196] systemd[1]: Stopped target Path Units. gitlab # [ 3.853381] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.856574] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.859789] systemd[1]: Stopped target Slice Units. gitlab # [ 3.862031] systemd[1]: Stopped target Socket Units. gitlab # [ 3.864219] systemd[1]: Stopped target System Initialization. gitlab # [ 3.869718] systemd[1]: Stopped target Swaps. gitlab # [ 3.871720] systemd[1]: Stopped target Timer Units. gitlab # [ 3.877464] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.880282] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.883276] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.887051] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.889523] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.892226] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.894902] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.897759] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.899824] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.902557] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.904398] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.907155] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.909793] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.912090] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.914170] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.915782] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.917904] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.919942] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.921572] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.923500] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.925512] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.926836] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.928475] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.930028] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.931710] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.933199] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.934816] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.936101] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.937664] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.939148] systemd[1]: systemd-udevd.service: Consumed 2.172s CPU time over 2.221s wall clock time, 31.8M memory peak. gitlab # [ 3.941339] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.942806] systemd[1]: Closed udev Control Socket. gitlab # [ 3.943840] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.945069] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.946636] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.947892] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.950785] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.952228] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.953624] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.028116] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.031389] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.033797] systemd[1]: Reached target Switch Root. gitlab # [ 4.035957] systemd[1]: Starting NixOS Activation... gitlab # [ 4.212430] initrd-nixos-activation-start[222]: booting system configuration /nix/store/a0qymq3jxbls8bajr4rh0r0i8xcbpbba-nixos-system-gitlab-test gitlab # [ 4.273669] initrd-nixos-activation-start[222]: running activation script... gitlab # [ 4.577872] initrd-nixos-activation-start[245]: setting up /etc... gitlab # [ 4.733507] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.736866] systemd[1]: Finished NixOS Activation. gitlab # [ 4.739019] systemd[1]: Starting Switch Root... gitlab # [ 4.782785] systemd[1]: Switching root. gitlab # [ 4.883214] systemd-journald[96]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.492139] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.492279] systemd[1]: Detected virtualization qemu. gitlab # [ 5.492355] systemd[1]: Detected architecture arm64. gitlab # [ 5.492535] systemd[1]: Detected first boot. gitlab # [ 5.493946] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.723724] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.855953] systemd[1]: Applying preset policy. gitlab # [ 6.054501] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.202903] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.203390] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.205917] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.210835] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.218248] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.221692] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.222322] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.227111] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.228322] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.229437] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.230524] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.231674] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.232739] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.233802] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.234885] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.236015] systemd[1]: Reached target Path Units. gitlab # [ 6.237118] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.238191] systemd[1]: Reached target Slice Units. gitlab # [ 6.239261] systemd[1]: Reached target Swaps. gitlab # [ 6.243291] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.247478] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.250499] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.254153] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.255497] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.264938] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.266903] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.268801] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.269426] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.269972] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.270630] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.273057] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.273601] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.274362] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.280724] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.285618] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.293269] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.307477] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.317472] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.327354] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.328672] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.339600] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.340799] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.341968] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.349712] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.350088] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.363276] systemd[1]: Starting Journal Service... gitlab # [ 6.371211] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.379279] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.384998] fuse: init (API version 7.45) gitlab # [ 6.385708] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.390604] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.398889] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.409617] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.410609] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.411530] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.412381] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.413285] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.414563] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.415823] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.416867] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.417834] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.418874] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.420101] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.421433] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.426413] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.432192] systemd-journald[316]: Collecting audit messages is enabled. gitlab # [ 6.441898] systemd[1]: Starting Firewall... gitlab # [ 6.455343] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.459201] EXT4-fs (vda): re-mounted 2740c36f-3aa7-45d9-9870-457e8fbc53c4. gitlab # [ 6.459516] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.464449] systemd[1]: systemd-journald.service: Deactivated successfully.[ 6.467798] systemd[1]: Starting Apply Kernel Variables... gitlab # gitlab # [ 6.468052] systemd-modules-load[317]: Using 3 probe threads gitlab # [ 6.470290] systemd-modules-load[317]: Module 'atkbd' is built in[ 6.473974] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # gitlab # [ 6.476437] systemd-modules-load[317]: Module 'loop' is built in gitlab # [ 6.477853] systemd-modules-load[317]: Inserted module 'tls'[ 6.481156] systemd[1]: Started Journal Service. gitlab # gitlab # [ 6.481157] systemd-oomd[318]: No swap; memory pressure usage will be degraded gitlab # [ 6.485235] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.490610] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.492910] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.504910] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.509673] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.516434] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.518302] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.535099] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.538831] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.540486] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.541787] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.548250] systemd-journald[316]: Received client request to flush runtime journal. gitlab # [ 6.579121] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.581089] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.582743] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.584236] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.585115] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.585963] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.616563] systemd-udevd[367]: Using default interface naming scheme 'v261'. gitlab # [ 6.650067] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.811636] systemd[1]: Finished Firewall. gitlab # [ 7.054466] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.144858] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.206395] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.209081] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.236957] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.241355] systemd[1]: Reached target Local File Systems. gitlab # [ 7.244245] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.247406] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.252376] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.255275] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.260509] (udev-worker)[414]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.263158] (udev-worker)[414]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.276221] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.277843] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.279472] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.314701] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.315998] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.320319] (udev-worker)[409]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.330841] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.339832] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.341166] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.342434] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.343934] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.346293] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.348062] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.351027] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.353374] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.355364] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.371859] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.381247] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.383639] systemd[1]: Starting Update is Completed... gitlab # [ 7.408748] systemd[1]: Finished Update is Completed. gitlab # [ 7.414270] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.462453] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.464765] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.466185] systemd[1]: suid-sgid-wrappers.service: Consumed 132ms CPU time over 211ms wall clock time, 6.5M memory peak, 1.9M read from disk. gitlab # [ 7.748645] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.750018] systemd[1]: Reached target System Initialization. gitlab # [ 7.750998] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.752863] systemd[1]: Started logrotate.timer. gitlab # [ 7.753769] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.755239] systemd[1]: Reached target Timer Units. gitlab # [ 7.756338] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.757686] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.765748] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.767831] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.769400] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.770283] systemd[1]: Reached target Socket Units. gitlab # [ 7.774105] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.798872] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 7.809892] dbus-broker-launch[558]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.812456] dbus-broker-launch[558]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.816162] dbus-broker-launch[558]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.825343] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.838050] dbus-broker-launch[558]: Ready gitlab # [ 7.841496] systemd[1]: Reached target Basic System. gitlab # [ 7.844290] systemd[1]: Started backdoor.service. gitlab # [ 7.852404] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.866255] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.874993] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.880617] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # connecting to host... gitlab # [ 7.887802] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.892210] systemd[1]: Started Reset console on configuration changes. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.900465] systemd[1]: Starting resolvconf update... gitlab # [ 7.907741] logrotate[565]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: connected to guest root shell gitlab # [ 7.910845] logrotate[565]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab: (connecting took 8.34 seconds) gitlab: (finished: waiting for the VM to finish booting, in 8.34 seconds) gitlab # [ 7.912329] logrotate[565]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.913477] logrotate[565]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.914445] logrotate[565]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.915538] logrotate[565]: Allocating hash table for state file, size 64 entries gitlab # [ 7.918190] logrotate[565]: Handling 4 logs gitlab # [ 7.918860] logrotate[565]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.921979] logrotate[565]: considering log /var/log/btmp gitlab # [ 7.922752] logrotate[565]: Creating new state gitlab # [ 7.923357] logrotate[565]: Now: 2026-08-20 08:48 gitlab # [ 7.924005] logrotate[565]: Last rotated at 2026-08-20 08:00 gitlab # [ 7.929876] logrotate[565]: log does not need rotating (log has already been rotated) gitlab # [ 7.931092] logrotate[565]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.933607] logrotate[565]: considering log /var/log/wtmp gitlab # [ 7.934355] logrotate[565]: Creating new state gitlab # [ 7.934969] logrotate[565]: Now: 2026-08-20 08:48 gitlab # [ 7.935628] logrotate[565]: Last rotated at 2026-08-20 08:00 gitlab # [ 7.936505] logrotate[565]: log does not need rotating (log has already been rotated) gitlab # [ 7.937544] logrotate[565]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.939328] logrotate[565]: switching euid from 0 to 165 and egid from 0 to 165 (pid 565) gitlab # [ 7.940414] logrotate[565]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.941280] logrotate[565]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.942341] logrotate[565]: Creating new state gitlab # [ 7.942957] logrotate[565]: switching euid from 165 to 0 and egid from 165 to 0 (pid 565) gitlab # [ 7.944049] logrotate[565]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.945711] logrotate[565]: switching euid from 0 to 60 and egid from 0 to 60 (pid 565) gitlab # [ 7.946771] logrotate[565]: considering log /var/log/nginx/*.log gitlab # [ 7.947571] logrotate[565]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.949193] logrotate[565]: Creating new state gitlab # [ 7.949839] logrotate[565]: not running postrotate script, since no logs were rotated gitlab # [ 7.950872] logrotate[565]: switching euid from 60 to 0 and egid from 60 to 0 (pid 565) gitlab # [ 7.954802] nsncd[568]: Aug 20 08:48:48.687 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.957255] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.988463] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.989547] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.995897] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.025233] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.041885] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.043941] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.047210] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.048229] systemd[1]: nscd.service: Consumed 24ms CPU time over 163ms wall clock time, 7.6M memory peak, 5.8M read from disk. gitlab # [ 8.049888] systemd[1]: Finished resolvconf update. gitlab # [ 8.051114] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.054387] systemd[1]: Starting DHCP Client... gitlab # [ 8.057127] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.060587] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.065407] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.085246] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.086602] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.087493] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.089506] nsncd[668]: Aug 20 08:48:48.858 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.093794] systemd[1]: Starting User Login Management... gitlab # [ 8.102420] network-addresses-eth1-start[663]: adding address 192.168.1.1/24... done gitlab # [ 8.105236] network-addresses-eth1-start[663]: adding address 2001:db8:1::1/64... done gitlab # [ 8.117399] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.119141] systemd-vconsole-setup[654]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.122458] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.163899] dhcpcd[688]: dhcpcd-10.3.2 starting gitlab # [ 8.165086] dhcpcd[741]: dev: loaded udev gitlab # [ 8.168446] systemd-logind[686]: New seat seat0. gitlab # [ 8.174189] systemd-logind[686]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.175690] systemd-logind[686]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.177035] systemd-logind[686]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.179223] systemd[1]: Started User Login Management.[ 8.181750] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.182168] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # gitlab # [ 8.188205] systemd[1]: Starting linger-users.service... gitlab # [ 8.189146] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.195929] systemd[1]: Reached target Network. gitlab # [ 8.197213] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.211325] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.219460] systemd[1]: Starting Nginx Web Server...[ 8.222676] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # gitlab # [ 8.227044] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.234011] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.232371] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.234514] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.237269] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.237620] cfg80211: failed to load regulatory.db gitlab # [ 8.238358] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.242246] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.244436] systemd[1]: Finished linger-users.service. gitlab # [ 8.269973] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.275508] systemd[1]: Started Getty on tty1. gitlab # [ 8.278523] systemd[1]: Reached target Login Prompts. gitlab # [ 8.282883] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.283262] dhcpcd[741]: eth0: waiting for carrier gitlab # [ 8.284108] dhcpcd[741]: eth0: carrier acquired gitlab # [ 8.292542] dhcpcd[741]: DUID 00:01:00:01:32:19:7b:f1:52:54:00:12:34:56 gitlab # [ 8.293571] dhcpcd[741]: eth0: IAID 00:12:34:56 gitlab # [ 8.294213] dhcpcd[741]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.365954] nginx-pre-start[786]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.367800] nginx-pre-start[786]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.374567] systemd[1]: Started Nginx Web Server. gitlab # [ 8.420110] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.421758] postgresql-pre-start[792]: This user must also own the server process. gitlab # [ 8.423537] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.426799] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.429025] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.430608] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.431989] postgresql-pre-start[792]: The default text search configuration will be set to "english". gitlab # [ 8.434141] postgresql-pre-start[792]: Data page checksums are enabled. gitlab # [ 8.436520] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.437945] postgresql-pre-start[792]: creating subdirectories ... ok gitlab # [ 8.438806] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.439962] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started gitlab # [ 8.442506] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.445121] redis-server[791]: Configuration loaded gitlab # [ 8.446811] redis[791]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.449363] redis[791]: Running mode=standalone, port=0. gitlab # [ 8.450275] redis[791]: Server initialized gitlab # [ 8.450998] redis[791]: Ready to accept connections unix gitlab # [ 8.451994] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.471088] postgresql-pre-start[792]: selecting default "max_connections" ... 100 gitlab # [ 8.528761] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.852580] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.964749] postgresql-pre-start[792]: selecting default time zone ... UTC gitlab # [ 8.968197] postgresql-pre-start[792]: creating configuration files ... ok gitlab # [ 9.154903] gitlab-workhorse[814]: time="2026-08-20T08:48:49Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.156613] gitlab-workhorse[814]: time="2026-08-20T08:48:49Z" level=info msg="Using redis/go-redis" gitlab # [ 9.157811] gitlab-workhorse[814]: time="2026-08-20T08:48:49Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.240365] postgresql-pre-start[792]: running bootstrap script ... ok gitlab # [ 9.858897] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok gitlab # [ 10.077144] dhcpcd[741]: eth0: soliciting a DHCP lease gitlab # [ 10.089213] dhcpcd[741]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 10.116242] dhcpcd[741]: eth0: probing address 10.0.2.15/24 gitlab # [ 10.189814] postgresql-pre-start[792]: syncing data to disk ... ok gitlab # [ 10.192737] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.196834] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.203535] postgresql-pre-start[792]: Success. You can now start the database server using: gitlab # [ 10.207517] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.336561] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.342521] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.346024] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.352360] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.354630] postgres[858]: [858] LOG: database system was shut down at 2026-08-20 08:48:50 GMT gitlab # [ 10.359972] postgres[849]: [849] LOG: database system is ready to accept connections gitlab # [ 10.365490] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.370659] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.741238] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[874]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 10.745490] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[874]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 10.806138] postgresql-setup-start[869]: CREATE DATABASE gitlab # [ 10.837397] systemd[1]: Finished gitlab-config.service. gitlab # [ 10.842910] systemd[1]: Started gitaly.service. gitlab # [ 10.857517] postgresql-setup-start[890]: CREATE ROLE gitlab # [ 10.884763] postgresql-setup-start[894]: ALTER DATABASE gitlab # [ 10.928351] dhcpcd[741]: eth0: soliciting an IPv6 router gitlab # [ 10.931007] dhcpcd[741]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.933601] dhcpcd[741]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.936138] dhcpcd[741]: eth0: adding route to fec0::/64 gitlab # [ 10.939228] dhcpcd[741]: eth0: adding default route via fe80::2 gitlab # [ 10.941752] postgresql-setup-start[900]: CREATE ROLE gitlab # [ 10.943637] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 10.946167] systemd[1]: Reached target PostgreSQL. gitlab # [ 10.950600] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 10.957321] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.161353] gitlab-postgresql-start[910]: CREATE DATABASE gitlab # [ 11.230978] gitlab-postgresql-start[925]: CREATE EXTENSION gitlab # [ 11.327953] gitlab-postgresql-start[932]: CREATE EXTENSION gitlab # [ 11.330000] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 11.528347] gitaly[892]: time="2026-08-20T08:48:52.295Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=892 gitlab # [ 11.554087] gitaly[892]: time="2026-08-20T08:48:52.296Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=892 gitlab # [ 11.556370] gitaly[892]: time="2026-08-20T08:48:52.296Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=892 gitlab # [ 11.560000] gitaly[892]: time="2026-08-20T08:48:52.296Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=892 gitlab # [ 11.563527] gitaly[892]: time="2026-08-20T08:48:52.296Z" level=info msg="Starting Gitaly" pid=892 version= gitlab # [ 11.766201] gitaly[892]: time="2026-08-20T08:48:52.536Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=239 pid=892 gitlab # [ 11.768860] gitaly[892]: time="2026-08-20T08:48:52.538Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=892 gitlab # [ 11.770527] gitaly[892]: time="2026-08-20T08:48:52.538Z" level=info msg="finished initializing command factory" duration_ms=0 pid=892 gitlab # [ 11.772257] gitaly[892]: time="2026-08-20T08:48:52.538Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-892/git-exec-3094961316.d/git pid=892 gitlab # [ 11.776664] gitaly[892]: time="2026-08-20T08:48:52.546Z" level=info msg="finished detecting git version" duration_ms=7 pid=892 gitlab # [ 11.778245] gitaly[892]: time="2026-08-20T08:48:52.546Z" level=info msg="using Git version" pid=892 version=2.53.g gitlab # [ 11.779620] gitaly[892]: time="2026-08-20T08:48:52.547Z" level=info msg="clearing disk cache object folder" pid=892 storage=default gitlab # [ 11.781219] gitaly[892]: time="2026-08-20T08:48:52.547Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3420487511 pid=892 storage=default gitlab # [ 11.783543] gitaly[892]: time="2026-08-20T08:48:52.547Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3420487511 pid=892 storage=default gitlab # [ 11.786373] gitaly[892]: time="2026-08-20T08:48:52.547Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=892 gitlab # [ 11.789243] gitaly[892]: time="2026-08-20T08:48:52.547Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=892 gitlab # [ 11.792141] gitaly[892]: time="2026-08-20T08:48:52.547Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3420487511 clear_duration_ms=0 pid=892 storage=default gitlab # [ 11.795014] gitaly[892]: time="2026-08-20T08:48:52.562Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=892 gitlab # [ 11.798195] gitaly[892]: time="2026-08-20T08:48:52.562Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=892 schema=unix gitlab # [ 11.800996] gitaly[892]: time="2026-08-20T08:48:52.562Z" level=info msg="listening at address" address=/run/gitaly/gitaly-892/sock.d/intern pid=892 schema=unix gitlab # [ 11.803698] gitaly[892]: time="2026-08-20T08:48:52.563Z" level=info msg="finished tempdir cleaner walk" pid=892 storage=default time_ms=0 gitlab # [ 11.806280] gitaly[892]: time="2026-08-20T08:48:52.563Z" level=info msg="counting repositories" pid=892 gitlab # [ 11.808259] gitaly[892]: time="2026-08-20T08:48:52.563Z" level=info msg="starting to count repositories" pid=892 storage_path=/var/gitlab/state/repositories gitlab # [ 11.810915] gitaly[892]: time="2026-08-20T08:48:52.563Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=892 storage_path=/var/gitlab/state/repositories gitlab # [ 11.814155] gitaly[892]: time="2026-08-20T08:48:52.563Z" level=info msg="completed counting all repositories" counting_duration=0 pid=892 gitlab # [ 11.816581] gitaly[892]: time="2026-08-20T08:48:52.564Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=892 gitlab # [ 11.818966] gitaly[892]: time="2026-08-20T08:48:52.564Z" level=info msg="Started Gitaly" duration_ms=268 pid=892 gitlab # [ 11.821044] gitaly[892]: time="2026-08-20T08:48:52.564Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=892 gitlab # [ 11.823548] gitaly[892]: time="2026-08-20T08:48:52.564Z" level=info msg="maintenance: daily scheduled" pid=892 scheduled="2026-08-20 12:00:00 +0000 UTC" gitlab # [ 12.246775] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[905]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.251083] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[905]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.275437] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[905]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 14.722014] dhcpcd[741]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 14.722359] dhcpcd[741]: eth0: adding route to 10.0.2.0/24 gitlab # [ 14.722497] dhcpcd[741]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.923686] systemd[1]: Started DHCP Client. gitlab # [ 14.926964] systemd[1]: Reached target Network is Online. gitlab # [ 15.225146] gitaly[892]: time="2026-08-20T08:48:55.994Z" level=info msg="License database preloaded" duration_ms=3697 pid=892 gitlab # [ 57.271200] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[905]: W, [2026-08-20T08:49:38.039605 #905] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.234677] gitlab-workhorse[814]: time="2026-08-20T08:49:40Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 60.374226] postgres[1434]: [1434] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 60.374683] postgres[1434]: [1434] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 60.374814] postgres[1434]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 60.374951] postgres[1434]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 60.375076] postgres[1434]: attidentity AS identity, gitlab # [ 60.375198] postgres[1434]: attgenerated as attgenerated gitlab # [ 60.375312] postgres[1434]: FROM pg_attribute a gitlab # [ 60.375430] postgres[1434]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 60.375552] postgres[1434]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 60.375667] postgres[1434]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 60.375789] postgres[1434]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 60.375910] postgres[1434]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 60.411593] postgres[1434]: ORDER BY a.attnum gitlab # [ 60.413684] postgres[1434]: gitlab # [ 65.451787] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1477]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 65.452391] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1477]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.243192] gitlab-workhorse[814]: time="2026-08-20T08:49:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.253666] gitlab-workhorse[814]: time="2026-08-20T08:50:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.254906] gitlab-workhorse[814]: time="2026-08-20T08:50:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 91.463102] postgres[1589]: [1589] ERROR: relation "table_without_models" does not exist gitlab # [ 91.463476] postgres[1589]: [1589] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.265183] gitlab-workhorse[814]: time="2026-08-20T08:50:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.274395] gitlab-workhorse[814]: time="2026-08-20T08:50:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.284698] gitlab-workhorse[814]: time="2026-08-20T08:50:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 121.814911] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 121.823571] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 121.827432] systemd[1]: Starting gitlab.service... gitlab # [ 122.383064] bundle[1959]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 122.389538] bundle[1959]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 122.395418] bundle[1959]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 127.055279] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.794Z","pid":1959,"message":"* Enabling systemd notification integration"} gitlab # [ 127.055705] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"Puma starting in cluster mode..."} gitlab # [ 127.055844] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 127.056001] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 127.056189] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Min threads: 0"} gitlab # [ 127.056302] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Max threads: 4"} gitlab # [ 127.056418] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Environment: production"} gitlab # [ 127.056533] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Master PID: 1959"} gitlab # [ 127.056648] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Workers: 2"} gitlab # [ 127.056762] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 127.056860] bundle[1959]: {"timestamp":"2026-08-20T08:50:47.824Z","pid":1959,"message":"* Preloading application"} gitlab # [ 127.119824] sidekiq-cluster[1958]: {"severity":"INFO","time":"2026-08-20T08:50:47.859Z","message":"Starting cluster with 1 processes"} gitlab # [ 129.289262] gitlab-workhorse[814]: time="2026-08-20T08:50:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.289775] gitlab-workhorse[814]: time="2026-08-20T08:51:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.298231] gitlab-workhorse[814]: time="2026-08-20T08:51:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.308418] gitlab-workhorse[814]: time="2026-08-20T08:51:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 165.394109] bundle[1959]: W, [2026-08-20T08:51:26.163053 #1959] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 168.875155] sidekiq-cluster[2004]: 2026-08-20T08:51:29.643Z pid=2004 tid=wos INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2004, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433127424} gitlab # [ 169.188519] sidekiq-cluster[2004]: W, [2026-08-20T08:51:29.958396 #2004] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.281075] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:30.050Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 169.319728] gitlab-workhorse[814]: time="2026-08-20T08:51:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 174.741173] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.509Z","message":"GitLab reliable fetch activated!"} gitlab # [ 174.741604] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.510Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 174.776173] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.546Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 174.783154] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.549Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 174.790344] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.552Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 174.797094] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.555Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 174.804747] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.558Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 174.811419] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.561Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 174.818080] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.563Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 174.823287] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.565Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 174.828371] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.568Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 174.832750] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.570Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 174.837328] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.572Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 174.841374] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.577Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 174.845077] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.580Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 174.848669] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.584Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 174.851976] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.589Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 174.855397] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.593Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 174.858675] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.599Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 174.861623] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.604Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 174.864666] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.608Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 174.867412] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.614Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 174.870603] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.620Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 174.873746] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.622Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 174.876452] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.625Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 174.879919] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.628Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 174.882821] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.631Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 174.885397] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.634Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 174.887775] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.637Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 174.890458] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.640Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 174.893083] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.643Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 174.895713] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.646Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 174.898398] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.648Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 174.901239] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.652Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 174.903698] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.654Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 174.906549] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.658Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 174.909252] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.660Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 174.911792] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.662Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 174.914647] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.664Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 174.917193] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.667Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 174.919645] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.669Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 174.922303] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.671Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 174.924986] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.673Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 174.927546] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.675Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 174.930318] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.677Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 174.932783] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.679Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 174.935229] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.682Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 174.937897] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.684Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 174.940246] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.686Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 174.942520] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.688Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 174.944796] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.690Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 174.946950] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.692Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 174.949212] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.695Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 174.951348] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.697Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 174.953624] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.710Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 174.955889] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.713Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 174.958191] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.715Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 174.960282] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.718Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 174.962359] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.720Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 174.964643] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.722Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 174.966834] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.724Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 174.969180] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.727Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 174.971181] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.729Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 174.973336] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.731Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 174.975450] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.733Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 174.977773] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.736Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 174.979972] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.738Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 174.982362] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.741Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 174.984458] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.744Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 174.986611] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.746Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 174.989007] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.748Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 174.991295] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.749Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 174.993700] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.751Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 174.995899] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.753Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 174.998328] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.756Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 175.000732] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.759Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 175.003114] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.760Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 175.005596] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.762Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 175.007810] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.765Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 175.010524] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.767Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 175.012789] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.768Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 175.014937] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.770Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 175.017408] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.773Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 175.019839] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.775Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 175.022364] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.778Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 175.024599] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.780Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 175.026929] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.782Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 175.029225] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.784Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 175.031564] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.787Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 175.034006] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.789Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 175.036295] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.791Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 175.038487] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.793Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 175.040782] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.795Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 175.043014] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.796Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 175.045405] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.798Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 175.047829] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.801Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 175.050045] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.805Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 175.052443] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.808Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 175.054696] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.810Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 175.057027] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.814Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 175.059244] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.828Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 175.061618] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.831Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 175.063773] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.833Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 175.066705] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.836Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 175.072187] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.841Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 175.077886] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.847Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 175.081802] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.851Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 175.088136] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.855Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 175.090466] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.859Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 175.144079] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.912Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 175.147019] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:51:35.916Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 179.331764] gitlab-workhorse[814]: time="2026-08-20T08:51:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.338589] gitlab-workhorse[814]: time="2026-08-20T08:51:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.346184] gitlab-workhorse[814]: time="2026-08-20T08:52:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 209.347776] gitlab-workhorse[814]: time="2026-08-20T08:52:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 215.928255] postgres[2751]: [2751] ERROR: relation "table_without_models" does not exist gitlab # [ 215.931776] postgres[2751]: [2751] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 217.888608] postgres[2771]: [2771] ERROR: relation "table_without_models" does not exist gitlab # [ 217.889981] postgres[2771]: [2771] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 219.354188] gitlab-workhorse[814]: time="2026-08-20T08:52:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 220.900406] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:21.669Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 220.904510] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:21.670Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 220.905588] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:21.670Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 220.905737] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:21.670Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 220.908190] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:21.677Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 223.569666] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:24.338Z","message":"Cleaning working queues"} gitlab # [ 223.570287] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:24.339Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fa44d0ec639affe418e7f243","created_at":"2026-08-20T08:50:41.958Z","trace_propagation_headers":{"sentry-trace":"7e024ea8ad4843d68c8eab55c6d07b7a-526fe1287c474cb7","baggage":"sentry-trace_id=7e024ea8ad4843d68c8eab55c6d07b7a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"0422e23f6c440dd7f2c916173289afd0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:50:41.969Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fa44d0ec639affe418e7f243: start","job_status":"start","queue_duration_s":102.370048,"scheduling_latency_s":102.370099} gitlab # [ 223.908326] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:24.677Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fa44d0ec639affe418e7f243","created_at":"2026-08-20T08:50:41.958Z","trace_propagation_headers":{"sentry-trace":"7e024ea8ad4843d68c8eab55c6d07b7a-526fe1287c474cb7","baggage":"sentry-trace_id=7e024ea8ad4843d68c8eab55c6d07b7a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"0422e23f6c440dd7f2c916173289afd0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:50:41.969Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fa44d0ec639affe418e7f243: done: 0.337424 sec","job_status":"done","queue_duration_s":102.370048,"scheduling_latency_s":102.370099,"redis_calls":29,"redis_duration_s":0.010829,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006195,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002944,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19527248,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.337424,"completed_at":"2026-08-20T08:52:24.677Z","load_balancing_strategy":"primary","db_duration_s":0.0991,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 225.178992] bundle[1959]: {"timestamp":"2026-08-20T08:52:25.947Z","pid":1959,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 225.179376] bundle[1959]: {"timestamp":"2026-08-20T08:52:25.948Z","pid":1959,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 225.179559] bundle[1959]: {"timestamp":"2026-08-20T08:52:25.948Z","pid":1959,"message":"! #\u003cThread:0x0000fc94daad0b58 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 225.179695] bundle[1959]: {"timestamp":"2026-08-20T08:52:25.948Z","pid":1959,"message":"! #\u003cThread:0x0000fc94dad0a1f8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 225.179812] bundle[1959]: {"timestamp":"2026-08-20T08:52:25.948Z","pid":1959,"message":"Use Ctrl-C to stop"} gitlab # [ 225.179928] bundle[1959]: {"timestamp":"2026-08-20T08:52:25.948Z","pid":1959,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 228.386571] bundle[1959]: {"timestamp":"2026-08-20T08:52:29.155Z","pid":1959,"message":"- Worker 0 (PID: 2892) booted in 3.17s, phase: 0"} gitlab # [ 228.389842] bundle[1959]: {"timestamp":"2026-08-20T08:52:29.159Z","pid":1959,"message":"- Worker 1 (PID: 2896) booted in 3.14s, phase: 0"} gitlab # [ 228.393676] systemd[1]: Started gitlab.service. gitlab # [ 228.394869] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 228.401317] systemd[1]: Starting setup-gitlab.service... gitlab # [ 228.460746] setup-gitlab-start[2943]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 229.503781] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:30 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 1001 gitlab # [ 229.510767] setup-gitlab-start[2943]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 229.514216] setup-gitlab-start[2943]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 229.531142] runuser[2964]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 230.039048] setup-gitlab-start[2965]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 230.045727] setup-gitlab-start[2965]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 230.052103] setup-gitlab-start[2965]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 230.869318] setup-gitlab-start[2965]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 230.869867] setup-gitlab-start[2965]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 230.872245] setup-gitlab-start[2965]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 235.611697] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:36.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cc1e01ecef28543fc491f45a","created_at":"2026-08-20T08:52:36.283Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aae82a3967e11b41dbe0a632b16d76de","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.376Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cc1e01ecef28543fc491f45a: start","job_status":"start","queue_duration_s":0.003279,"scheduling_latency_s":0.00334} gitlab # [ 235.854604] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:36.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"cc1e01ecef28543fc491f45a","created_at":"2026-08-20T08:52:36.283Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aae82a3967e11b41dbe0a632b16d76de","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.376Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-cc1e01ecef28543fc491f45a: done: 0.243825 sec","job_status":"done","queue_duration_s":0.003279,"scheduling_latency_s":0.00334,"redis_calls":10,"redis_duration_s":0.031953999999999996,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011322,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.016168,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053388,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.243825,"completed_at":"2026-08-20T08:52:36.623Z","load_balancing_strategy":"primary","db_duration_s":0.07646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.944383] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:36.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6e85eb25b0543f16c3545059","created_at":"2026-08-20T08:52:36.388Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de84df8d423e608592a8e7f60b75fb57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.404Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6e85eb25b0543f16c3545059: start","job_status":"start","queue_duration_s":0.227834,"scheduling_latency_s":0.227881} gitlab # [ 236.192518] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:36.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6e85eb25b0543f16c3545059","created_at":"2026-08-20T08:52:36.388Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de84df8d423e608592a8e7f60b75fb57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.404Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6e85eb25b0543f16c3545059: done: 0.329114 sec","job_status":"done","queue_duration_s":0.227834,"scheduling_latency_s":0.227881,"redis_calls":14,"redis_duration_s":0.013562,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002627,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003206,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00150612,"exclusive_lock_hold_duration_s":0.24062435999999998,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.329114,"completed_at":"2026-08-20T08:52:36.961Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.117458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.282534] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:36.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1cad877531f048ab7baaf64e","created_at":"2026-08-20T08:52:36.410Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d402a0e556c71b631c9789fad160f69","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.433Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1cad877531f048ab7baaf64e: start","job_status":"start","queue_duration_s":0.556022,"scheduling_latency_s":0.556077} gitlab # [ 236.406132] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1cad877531f048ab7baaf64e","created_at":"2026-08-20T08:52:36.410Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d402a0e556c71b631c9789fad160f69","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.433Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1cad877531f048ab7baaf64e: done: 0.185535 sec","job_status":"done","queue_duration_s":0.556022,"scheduling_latency_s":0.556077,"redis_calls":12,"redis_duration_s":0.075307,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.012818,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.039378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.023111,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0015278,"exclusive_lock_hold_duration_s":0.01051834,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.185535,"completed_at":"2026-08-20T08:52:37.174Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.497054] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5f77b20d588a93cff11e0366","created_at":"2026-08-20T08:52:36.446Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d67257e917478e449f1ac7fb754cb186","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.467Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5f77b20d588a93cff11e0366: start","job_status":"start","queue_duration_s":0.713619,"scheduling_latency_s":0.713666} gitlab # [ 236.515310] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.279Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 236.536573] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5f77b20d588a93cff11e0366","created_at":"2026-08-20T08:52:36.446Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d67257e917478e449f1ac7fb754cb186","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.467Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5f77b20d588a93cff11e0366: done: 0.124859 sec","job_status":"done","queue_duration_s":0.713619,"scheduling_latency_s":0.713666,"redis_calls":10,"redis_duration_s":0.005859,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003149,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062856,"duration_s":0.124859,"completed_at":"2026-08-20T08:52:37.305Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.605643] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"046c2b101a7301dc822abe46","created_at":"2026-08-20T08:52:36.496Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6533ae09276d4833d501ca001fb480c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:52:36.509Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-046c2b101a7301dc822abe46: start","job_status":"start","queue_duration_s":0.800288,"scheduling_latency_s":0.800335} gitlab # [ 236.621288] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.375Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 236.635120] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"046c2b101a7301dc822abe46","created_at":"2026-08-20T08:52:36.496Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6533ae09276d4833d501ca001fb480c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:52:36.509Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-046c2b101a7301dc822abe46: done: 0.093718 sec","job_status":"done","queue_duration_s":0.800288,"scheduling_latency_s":0.800335,"redis_calls":10,"redis_duration_s":0.003516,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000803,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002001,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063774,"duration_s":0.093718,"completed_at":"2026-08-20T08:52:37.403Z","load_balancing_strategy":"primary","db_duration_s":0.003067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.688131] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:37.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3974acf7374a46f653ecda3c","created_at":"2026-08-20T08:52:36.525Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9367c55cc462fac34fdcedf4308c2218","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.545Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3974acf7374a46f653ecda3c: start","job_status":"start","queue_duration_s":0.863642,"scheduling_latency_s":0.863689} gitlab # [ 237.263999] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3974acf7374a46f653ecda3c","created_at":"2026-08-20T08:52:36.525Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9367c55cc462fac34fdcedf4308c2218","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.545Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3974acf7374a46f653ecda3c: done: 0.62417 sec","job_status":"done","queue_duration_s":0.863642,"scheduling_latency_s":0.863689,"redis_calls":565,"redis_duration_s":0.208449,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003734,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.203101,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.405829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030658,"duration_s":0.62417,"completed_at":"2026-08-20T08:52:38.033Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.324314] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.035Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"2f407a854fad8c616571fd39","created_at":"2026-08-20T08:52:36.561Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7dfd0cf04a38733e4606ceba20488c5f","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.588Z","job_size_bytes":3,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-2f407a854fad8c616571fd39: start","job_status":"start","queue_duration_s":1.44698,"scheduling_latency_s":1.447011} gitlab # [ 237.338908] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.058Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"2f407a854fad8c616571fd39","created_at":"2026-08-20T08:52:36.561Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7dfd0cf04a38733e4606ceba20488c5f","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.588Z","job_size_bytes":3,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-2f407a854fad8c616571fd39: done: 0.023509 sec","job_status":"done","queue_duration_s":1.44698,"scheduling_latency_s":1.447011,"redis_calls":10,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026182,"duration_s":0.023509,"completed_at":"2026-08-20T08:52:38.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.383156] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b6992bec04f5e4b3aa2a238","created_at":"2026-08-20T08:52:36.596Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"522b0d9fd31bad73e0a4ead4132eb50b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:52:36.635Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b6992bec04f5e4b3aa2a238: start","job_status":"start","queue_duration_s":1.424669,"scheduling_latency_s":1.424691} gitlab # [ 237.397177] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.072Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 237.400825] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b6992bec04f5e4b3aa2a238","created_at":"2026-08-20T08:52:36.596Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"522b0d9fd31bad73e0a4ead4132eb50b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:52:36.635Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b6992bec04f5e4b3aa2a238: done: 0.02064 sec","job_status":"done","queue_duration_s":1.424669,"scheduling_latency_s":1.424691,"redis_calls":10,"redis_duration_s":0.0014160000000000002,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023664,"duration_s":0.02064,"completed_at":"2026-08-20T08:52:38.080Z","load_balancing_strategy":"primary","db_duration_s":0.000638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.442831] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2caf7c70d10cafd3384b258f","created_at":"2026-08-20T08:52:36.678Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"faf39b1a5103bd35fba41ad78930d5d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.694Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2caf7c70d10cafd3384b258f: start","job_status":"start","queue_duration_s":1.387694,"scheduling_latency_s":1.387715} gitlab # [ 237.457616] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2caf7c70d10cafd3384b258f","created_at":"2026-08-20T08:52:36.678Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"faf39b1a5103bd35fba41ad78930d5d0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.694Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2caf7c70d10cafd3384b258f: done: 0.028261 sec","job_status":"done","queue_duration_s":1.387694,"scheduling_latency_s":1.387715,"redis_calls":12,"redis_duration_s":0.001727,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049224,"exclusive_lock_hold_duration_s":0.00816446,"duration_s":0.028261,"completed_at":"2026-08-20T08:52:38.110Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.500548] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"44ff93e1f04615a7ce4edfa7","created_at":"2026-08-20T08:52:36.750Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"828591c4cc7d169551cf8becc0cde0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.766Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-44ff93e1f04615a7ce4edfa7: start","job_status":"start","queue_duration_s":1.34553,"scheduling_latency_s":1.345549} gitlab # [ 237.609614] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"44ff93e1f04615a7ce4edfa7","created_at":"2026-08-20T08:52:36.750Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"828591c4cc7d169551cf8becc0cde0f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.766Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-44ff93e1f04615a7ce4edfa7: done: 0.26762 sec","job_status":"done","queue_duration_s":1.34553,"scheduling_latency_s":1.345549,"redis_calls":14,"redis_duration_s":0.002749,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000572,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049968,"exclusive_lock_hold_duration_s":0.24346008,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.26762,"completed_at":"2026-08-20T08:52:38.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.695393] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e487ae5ef620b869e83f767e","created_at":"2026-08-20T08:52:36.836Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6971715a3574be6a4c05557997ab0d6d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.846Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e487ae5ef620b869e83f767e: start","job_status":"start","queue_duration_s":1.533599,"scheduling_latency_s":1.533617} gitlab # [ 237.712201] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e487ae5ef620b869e83f767e","created_at":"2026-08-20T08:52:36.836Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6971715a3574be6a4c05557997ab0d6d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.846Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e487ae5ef620b869e83f767e: done: 0.031209 sec","job_status":"done","queue_duration_s":1.533599,"scheduling_latency_s":1.533617,"redis_calls":10,"redis_duration_s":0.001429,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025496,"duration_s":0.031209,"completed_at":"2026-08-20T08:52:38.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.755399] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fbd98f96bd5c6f4ea25bd7c6","created_at":"2026-08-20T08:52:36.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"729316dd7874f5e225073b73df953dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.870Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fbd98f96bd5c6f4ea25bd7c6: start","job_status":"start","queue_duration_s":1.543093,"scheduling_latency_s":1.543111} gitlab # [ 237.770545] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fbd98f96bd5c6f4ea25bd7c6","created_at":"2026-08-20T08:52:36.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"729316dd7874f5e225073b73df953dbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.870Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fbd98f96bd5c6f4ea25bd7c6: done: 0.023243 sec","job_status":"done","queue_duration_s":1.543093,"scheduling_latency_s":1.543111,"redis_calls":12,"redis_duration_s":0.001821,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000642,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023968,"duration_s":0.023243,"completed_at":"2026-08-20T08:52:38.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.815248] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a57ee8962852c403901a8749","created_at":"2026-08-20T08:52:36.895Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b49a4e7a188a168576f855dffea1b40c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.923Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a57ee8962852c403901a8749: start","job_status":"start","queue_duration_s":1.514308,"scheduling_latency_s":1.514327} gitlab # [ 237.830219] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a57ee8962852c403901a8749","created_at":"2026-08-20T08:52:36.895Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b49a4e7a188a168576f855dffea1b40c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.923Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a57ee8962852c403901a8749: done: 0.031947 sec","job_status":"done","queue_duration_s":1.514308,"scheduling_latency_s":1.514327,"redis_calls":13,"redis_duration_s":0.002005,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01060762,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.031947,"completed_at":"2026-08-20T08:52:38.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003742,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 237.874958] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d00403a7f0d9950146987871","created_at":"2026-08-20T08:52:36.940Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.968Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d00403a7f0d9950146987871: start","job_status":"start","queue_duration_s":1.503001,"scheduling_latency_s":1.50302} gitlab # [ 237.888832] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d00403a7f0d9950146987871","created_at":"2026-08-20T08:52:36.940Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:36.968Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d00403a7f0d9950146987871: done: 0.037358 sec","job_status":"done","queue_duration_s":1.503001,"scheduling_latency_s":1.50302,"redis_calls":19,"redis_duration_s":0.002742,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000609,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000295,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022918,"duration_s":0.037358,"completed_at":"2026-08-20T08:52:38.508Z","load_balancing_strategy":"primary","db_duration_s":0.00304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.932130] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1726878fb7632b84072eefb7","created_at":"2026-08-20T08:52:36.979Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"069307126eb903aaca93af403e3ffd22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.010Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1726878fb7632b84072eefb7: start","job_status":"start","queue_duration_s":1.500067,"scheduling_latency_s":1.500084} gitlab # [ 237.946849] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.521Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 237.950522] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1726878fb7632b84072eefb7","created_at":"2026-08-20T08:52:36.979Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"069307126eb903aaca93af403e3ffd22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.010Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1726878fb7632b84072eefb7: done: 0.018936 sec","job_status":"done","queue_duration_s":1.500067,"scheduling_latency_s":1.500084,"redis_calls":10,"redis_duration_s":0.001279,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022448,"duration_s":0.018936,"completed_at":"2026-08-20T08:52:38.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.994872] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.530Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c8203c22d756112999450a61","created_at":"2026-08-20T08:52:37.022Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c007e757beaa74f5ba7d0b261baaa11e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.039Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c8203c22d756112999450a61: start","job_status":"start","queue_duration_s":1.490297,"scheduling_latency_s":1.490314} gitlab # [ 238.008463] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c8203c22d756112999450a61","created_at":"2026-08-20T08:52:37.022Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c007e757beaa74f5ba7d0b261baaa11e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.039Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c8203c22d756112999450a61: done: 0.019533 sec","job_status":"done","queue_duration_s":1.490297,"scheduling_latency_s":1.490314,"redis_calls":12,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000363,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022478,"duration_s":0.019533,"completed_at":"2026-08-20T08:52:38.549Z","load_balancing_strategy":"primary","db_duration_s":0.00046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.051237] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.550Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3b3318f2312d5e21ec31b3a1","created_at":"2026-08-20T08:52:37.062Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12cc919642c192c8725b897dedebcd64","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.078Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3b3318f2312d5e21ec31b3a1: start","job_status":"start","queue_duration_s":1.472548,"scheduling_latency_s":1.472566} gitlab # [ 238.066093] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3b3318f2312d5e21ec31b3a1","created_at":"2026-08-20T08:52:37.062Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12cc919642c192c8725b897dedebcd64","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.078Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3b3318f2312d5e21ec31b3a1: done: 0.018616 sec","job_status":"done","queue_duration_s":1.472548,"scheduling_latency_s":1.472566,"redis_calls":10,"redis_duration_s":0.001324,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022708,"duration_s":0.018616,"completed_at":"2026-08-20T08:52:38.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.108725] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5de4390d039d964231cdf903","created_at":"2026-08-20T08:52:37.088Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cfdcc63e38946e34e4d0a6ac21635c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.114Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5de4390d039d964231cdf903: start","job_status":"start","queue_duration_s":1.455989,"scheduling_latency_s":1.456009} gitlab # [ 238.122457] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5de4390d039d964231cdf903","created_at":"2026-08-20T08:52:37.088Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cfdcc63e38946e34e4d0a6ac21635c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.114Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5de4390d039d964231cdf903: done: 0.027764 sec","job_status":"done","queue_duration_s":1.455989,"scheduling_latency_s":1.456009,"redis_calls":12,"redis_duration_s":0.001622,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048436,"exclusive_lock_hold_duration_s":0.0090176,"duration_s":0.027764,"completed_at":"2026-08-20T08:52:38.598Z","load_balancing_strategy":"primary","db_duration_s":0.004722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.164273] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3c0c1800fc29aeef05bef72c","created_at":"2026-08-20T08:52:37.164Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93db3c9e01af5f773c201c5975c88e0e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.184Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3c0c1800fc29aeef05bef72c: start","job_status":"start","queue_duration_s":1.41554,"scheduling_latency_s":1.415558} gitlab # [ 238.179062] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.611Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 238.182882] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3c0c1800fc29aeef05bef72c","created_at":"2026-08-20T08:52:37.164Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93db3c9e01af5f773c201c5975c88e0e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.184Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3c0c1800fc29aeef05bef72c: done: 0.01877 sec","job_status":"done","queue_duration_s":1.41554,"scheduling_latency_s":1.415558,"redis_calls":10,"redis_duration_s":0.001549,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023342,"duration_s":0.01877,"completed_at":"2026-08-20T08:52:38.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.227066] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"95e9346a56de1a05e7b8c156","created_at":"2026-08-20T08:52:37.265Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed1e5dc40b7fd6eecbc4e9d917c40704","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.301Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-95e9346a56de1a05e7b8c156: start","job_status":"start","queue_duration_s":1.318065,"scheduling_latency_s":1.318081} gitlab # [ 238.241557] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.632Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 238.244654] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"95e9346a56de1a05e7b8c156","created_at":"2026-08-20T08:52:37.265Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed1e5dc40b7fd6eecbc4e9d917c40704","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.301Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-95e9346a56de1a05e7b8c156: done: 0.019239 sec","job_status":"done","queue_duration_s":1.318065,"scheduling_latency_s":1.318081,"redis_calls":10,"redis_duration_s":0.0013709999999999998,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024816,"duration_s":0.019239,"completed_at":"2026-08-20T08:52:38.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.287304] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.640Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8d529804b5bdedae449f20c3","created_at":"2026-08-20T08:52:37.337Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c92587bab6e2c3dc2eeab6026164378","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.397Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8d529804b5bdedae449f20c3: start","job_status":"start","queue_duration_s":1.2425,"scheduling_latency_s":1.242517} gitlab # [ 238.301382] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8d529804b5bdedae449f20c3","created_at":"2026-08-20T08:52:37.337Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c92587bab6e2c3dc2eeab6026164378","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.397Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8d529804b5bdedae449f20c3: done: 0.047441 sec","job_status":"done","queue_duration_s":1.2425,"scheduling_latency_s":1.242517,"redis_calls":16,"redis_duration_s":0.002596,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001334,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038984,"duration_s":0.047441,"completed_at":"2026-08-20T08:52:38.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.343489] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"26240821d640d93bd943e10a","created_at":"2026-08-20T08:52:37.456Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.493Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-26240821d640d93bd943e10a: start","job_status":"start","queue_duration_s":1.195023,"scheduling_latency_s":1.19504} gitlab # [ 238.357237] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"26240821d640d93bd943e10a","created_at":"2026-08-20T08:52:37.456Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.493Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-26240821d640d93bd943e10a: done: 0.113184 sec","job_status":"done","queue_duration_s":1.195023,"scheduling_latency_s":1.19504,"redis_calls":71,"redis_duration_s":0.010539999999999999,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001335,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000735,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008006,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024514,"duration_s":0.113184,"completed_at":"2026-08-20T08:52:38.802Z","load_balancing_strategy":"primary","db_duration_s":0.005567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.402000] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d314bd763d5d412553e1a1b5","created_at":"2026-08-20T08:52:37.539Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8929a181659623833592230b0cc77cea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.562Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d314bd763d5d412553e1a1b5: start","job_status":"start","queue_duration_s":1.241558,"scheduling_latency_s":1.241581} gitlab # [ 238.416269] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d314bd763d5d412553e1a1b5","created_at":"2026-08-20T08:52:37.539Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8929a181659623833592230b0cc77cea","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.562Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d314bd763d5d412553e1a1b5: done: 0.027281 sec","job_status":"done","queue_duration_s":1.241558,"scheduling_latency_s":1.241581,"redis_calls":10,"redis_duration_s":0.001592,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022462,"duration_s":0.027281,"completed_at":"2026-08-20T08:52:38.830Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.458091] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ffb3a0c00bd68035419b0093","created_at":"2026-08-20T08:52:37.580Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"838436e2dbacf1efd31924ef79750e04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:52:37.600Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ffb3a0c00bd68035419b0093: start","job_status":"start","queue_duration_s":1.231328,"scheduling_latency_s":1.231346} gitlab # [ 238.471304] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ffb3a0c00bd68035419b0093","created_at":"2026-08-20T08:52:37.580Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"838436e2dbacf1efd31924ef79750e04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:52:37.600Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ffb3a0c00bd68035419b0093: done: 0.034641 sec","job_status":"done","queue_duration_s":1.231328,"scheduling_latency_s":1.231346,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002376,"duration_s":0.034641,"completed_at":"2026-08-20T08:52:38.866Z","load_balancing_strategy":"primary","db_duration_s":0.006609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.512237] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"42591674733f813d436b8e76","created_at":"2026-08-20T08:52:37.636Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2aed90e9268f1b66d8141eac3c996101","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.684Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-42591674733f813d436b8e76: start","job_status":"start","queue_duration_s":1.183552,"scheduling_latency_s":1.183569} gitlab # [ 238.526820] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"42591674733f813d436b8e76","created_at":"2026-08-20T08:52:37.636Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2aed90e9268f1b66d8141eac3c996101","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:37.684Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-42591674733f813d436b8e76: done: 0.049334 sec","job_status":"done","queue_duration_s":1.183552,"scheduling_latency_s":1.183569,"redis_calls":12,"redis_duration_s":0.0019190000000000001,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052996,"exclusive_lock_hold_duration_s":0.0211525,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.049334,"completed_at":"2026-08-20T08:52:38.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.571906] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"08a53c559ac0475499d039c7","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-08a53c559ac0475499d039c7: start","job_status":"start","queue_duration_s":0.417798,"scheduling_latency_s":0.417815} gitlab # [ 238.584532] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.936Z","message":"No existing merge request to be cleaned up."} gitlab # [ 238.586194] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.951Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"08a53c559ac0475499d039c7","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-08a53c559ac0475499d039c7: done: 0.032707 sec","job_status":"done","queue_duration_s":0.417798,"scheduling_latency_s":0.417815,"redis_calls":13,"redis_duration_s":0.002036,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003021,"duration_s":0.032707,"completed_at":"2026-08-20T08:52:38.951Z","load_balancing_strategy":"primary","db_duration_s":0.005826,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.627654] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.952Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6272d6ab56508062df34efea","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6272d6ab56508062df34efea: start","job_status":"start","queue_duration_s":0.451638,"scheduling_latency_s":0.451656} gitlab # [ 238.640210] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.963Z","message":"No existing merge request to be cleaned up."} gitlab # [ 238.641889] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.972Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6272d6ab56508062df34efea","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6272d6ab56508062df34efea: done: 0.019896 sec","job_status":"done","queue_duration_s":0.451638,"scheduling_latency_s":0.451656,"redis_calls":10,"redis_duration_s":0.001341,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000772,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019896,"completed_at":"2026-08-20T08:52:38.972Z","load_balancing_strategy":"primary","db_duration_s":0.002645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.680565] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.973Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"99bd479577e41892c3747857","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-99bd479577e41892c3747857: start","job_status":"start","queue_duration_s":0.472601,"scheduling_latency_s":0.472617} gitlab # [ 238.693511] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.984Z","message":"No existing merge request to be cleaned up."} gitlab # [ 238.695655] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.993Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"99bd479577e41892c3747857","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-99bd479577e41892c3747857: done: 0.019826 sec","job_status":"done","queue_duration_s":0.472601,"scheduling_latency_s":0.472617,"redis_calls":10,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019826,"completed_at":"2026-08-20T08:52:38.993Z","load_balancing_strategy":"primary","db_duration_s":0.00245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.734566] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:38.994Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e21fb4c8754b8bbcf4764866","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e21fb4c8754b8bbcf4764866: start","job_status":"start","queue_duration_s":0.493557,"scheduling_latency_s":0.493574} gitlab # [ 238.746939] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.005Z","message":"No existing merge request to be cleaned up."} gitlab # [ 238.748667] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.014Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e21fb4c8754b8bbcf4764866","created_at":"2026-08-20T08:52:38.487Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a32f4a37fbc44dc9","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"61749c54d69d23ac76ba3fb9ec130cff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.501Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e21fb4c8754b8bbcf4764866: done: 0.019626 sec","job_status":"done","queue_duration_s":0.493557,"scheduling_latency_s":0.493574,"redis_calls":10,"redis_duration_s":0.001494,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019626,"completed_at":"2026-08-20T08:52:39.014Z","load_balancing_strategy":"primary","db_duration_s":0.002296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.787347] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c4a8581b29f09e8d2430a66","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c4a8581b29f09e8d2430a66: start","job_status":"start","queue_duration_s":0.22281,"scheduling_latency_s":0.222827} gitlab # [ 238.801696] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c4a8581b29f09e8d2430a66","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c4a8581b29f09e8d2430a66: done: 0.02208 sec","job_status":"done","queue_duration_s":0.22281,"scheduling_latency_s":0.222827,"redis_calls":16,"redis_duration_s":0.0020369999999999997,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022818,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02208,"completed_at":"2026-08-20T08:52:39.037Z","load_balancing_strategy":"primary","db_duration_s":0.000828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.843632] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6281dcb0c0e9d7402e2248fe","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6281dcb0c0e9d7402e2248fe: start","job_status":"start","queue_duration_s":0.246164,"scheduling_latency_s":0.246182} gitlab # [ 238.856610] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6281dcb0c0e9d7402e2248fe","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6281dcb0c0e9d7402e2248fe: done: 0.014836 sec","job_status":"done","queue_duration_s":0.246164,"scheduling_latency_s":0.246182,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014836,"completed_at":"2026-08-20T08:52:39.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.896296] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c14cd59d55edc9822ded1f3f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c14cd59d55edc9822ded1f3f: start","job_status":"start","queue_duration_s":0.262307,"scheduling_latency_s":0.262324} gitlab # [ 238.909094] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c14cd59d55edc9822ded1f3f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c14cd59d55edc9822ded1f3f: done: 0.014651 sec","job_status":"done","queue_duration_s":0.262307,"scheduling_latency_s":0.262324,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014651,"completed_at":"2026-08-20T08:52:39.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.948470] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e617773d2fbe008e181bb8c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e617773d2fbe008e181bb8c: start","job_status":"start","queue_duration_s":0.27823,"scheduling_latency_s":0.278246} gitlab # [ 238.960900] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e617773d2fbe008e181bb8c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e617773d2fbe008e181bb8c: done: 0.014546 sec","job_status":"done","queue_duration_s":0.27823,"scheduling_latency_s":0.278246,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014546,"completed_at":"2026-08-20T08:52:39.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.002067] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1525c659050a20985308db","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1525c659050a20985308db: start","job_status":"start","queue_duration_s":0.294261,"scheduling_latency_s":0.294279} gitlab # [ 239.014593] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1525c659050a20985308db","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1525c659050a20985308db: done: 0.014693 sec","job_status":"done","queue_duration_s":0.294261,"scheduling_latency_s":0.294279,"redis_calls":13,"redis_duration_s":0.0014390000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014693,"completed_at":"2026-08-20T08:52:39.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.054767] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bba420c812ddae55d1579de","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bba420c812ddae55d1579de: start","job_status":"start","queue_duration_s":0.310382,"scheduling_latency_s":0.310401} gitlab # [ 239.067828] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bba420c812ddae55d1579de","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bba420c812ddae55d1579de: done: 0.015077 sec","job_status":"done","queue_duration_s":0.310382,"scheduling_latency_s":0.310401,"redis_calls":13,"redis_duration_s":0.001706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015077,"completed_at":"2026-08-20T08:52:39.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.107989] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ebeafd511ca44b7410a8b57","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ebeafd511ca44b7410a8b57: start","job_status":"start","queue_duration_s":0.326385,"scheduling_latency_s":0.326403} gitlab # [ 239.120358] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ebeafd511ca44b7410a8b57","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ebeafd511ca44b7410a8b57: done: 0.014749 sec","job_status":"done","queue_duration_s":0.326385,"scheduling_latency_s":0.326403,"redis_calls":13,"redis_duration_s":0.0014329999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014749,"completed_at":"2026-08-20T08:52:39.133Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.160245] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64911d68cb76af1859c3e27a","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64911d68cb76af1859c3e27a: start","job_status":"start","queue_duration_s":0.342291,"scheduling_latency_s":0.342309} gitlab # [ 239.173020] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64911d68cb76af1859c3e27a","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64911d68cb76af1859c3e27a: done: 0.01491 sec","job_status":"done","queue_duration_s":0.342291,"scheduling_latency_s":0.342309,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01491,"completed_at":"2026-08-20T08:52:39.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.213912] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77edb08e541b79cf5df9e089","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77edb08e541b79cf5df9e089: start","job_status":"start","queue_duration_s":0.358681,"scheduling_latency_s":0.3587} gitlab # [ 239.226284] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77edb08e541b79cf5df9e089","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77edb08e541b79cf5df9e089: done: 0.015167 sec","job_status":"done","queue_duration_s":0.358681,"scheduling_latency_s":0.3587,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015167,"completed_at":"2026-08-20T08:52:39.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.265809] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"242122f377e632ae16557f9b","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-242122f377e632ae16557f9b: start","job_status":"start","queue_duration_s":0.374962,"scheduling_latency_s":0.37498} gitlab # [ 239.278534] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"242122f377e632ae16557f9b","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-242122f377e632ae16557f9b: done: 0.015051 sec","job_status":"done","queue_duration_s":0.374962,"scheduling_latency_s":0.37498,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015051,"completed_at":"2026-08-20T08:52:39.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.318000] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6365e01359589cbeea0309a","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6365e01359589cbeea0309a: start","job_status":"start","queue_duration_s":0.39109,"scheduling_latency_s":0.391107} gitlab # [ 239.330693] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6365e01359589cbeea0309a","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6365e01359589cbeea0309a: done: 0.014427 sec","job_status":"done","queue_duration_s":0.39109,"scheduling_latency_s":0.391107,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014427,"completed_at":"2026-08-20T08:52:39.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.370351] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1cae6d5b7dd1be4a19f98fa","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1cae6d5b7dd1be4a19f98fa: start","job_status":"start","queue_duration_s":0.406798,"scheduling_latency_s":0.406815} gitlab # [ 239.383096] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1cae6d5b7dd1be4a19f98fa","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1cae6d5b7dd1be4a19f98fa: done: 0.015273 sec","job_status":"done","queue_duration_s":0.406798,"scheduling_latency_s":0.406815,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015273,"completed_at":"2026-08-20T08:52:39.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.424542] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4371acf079517fe276aa5f5d","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4371acf079517fe276aa5f5d: start","job_status":"start","queue_duration_s":0.423344,"scheduling_latency_s":0.423361} gitlab # [ 239.436822] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4371acf079517fe276aa5f5d","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4371acf079517fe276aa5f5d: done: 0.014374 sec","job_status":"done","queue_duration_s":0.423344,"scheduling_latency_s":0.423361,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014374,"completed_at":"2026-08-20T08:52:39.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.477092] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"342be7b368eb9851ac7778f9","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-342be7b368eb9851ac7778f9: start","job_status":"start","queue_duration_s":0.438958,"scheduling_latency_s":0.438976} gitlab # [ 239.489716] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"342be7b368eb9851ac7778f9","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-342be7b368eb9851ac7778f9: done: 0.01456 sec","job_status":"done","queue_duration_s":0.438958,"scheduling_latency_s":0.438976,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01456,"completed_at":"2026-08-20T08:52:39.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.529187] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208bda6252bd67ba56a6acc4","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208bda6252bd67ba56a6acc4: start","job_status":"start","queue_duration_s":0.45476,"scheduling_latency_s":0.454778} gitlab # [ 239.541829] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208bda6252bd67ba56a6acc4","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208bda6252bd67ba56a6acc4: done: 0.014649 sec","job_status":"done","queue_duration_s":0.45476,"scheduling_latency_s":0.454778,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014649,"completed_at":"2026-08-20T08:52:39.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.581127] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"273f4067540d65538593d44c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-273f4067540d65538593d44c: start","job_status":"start","queue_duration_s":0.470705,"scheduling_latency_s":0.470722} gitlab # [ 239.593658] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"273f4067540d65538593d44c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-273f4067540d65538593d44c: done: 0.014462 sec","job_status":"done","queue_duration_s":0.470705,"scheduling_latency_s":0.470722,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014462,"completed_at":"2026-08-20T08:52:39.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.634462] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbcc649a32e53237bc04d9a0","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbcc649a32e53237bc04d9a0: start","job_status":"start","queue_duration_s":0.486341,"scheduling_latency_s":0.486358} gitlab # [ 239.647131] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbcc649a32e53237bc04d9a0","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbcc649a32e53237bc04d9a0: done: 0.014937 sec","job_status":"done","queue_duration_s":0.486341,"scheduling_latency_s":0.486358,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014937,"completed_at":"2026-08-20T08:52:39.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.686789] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c3ec42304ead317a711b59","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c3ec42304ead317a711b59: start","job_status":"start","queue_duration_s":0.502382,"scheduling_latency_s":0.502399} gitlab # [ 239.700251] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c3ec42304ead317a711b59","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c3ec42304ead317a711b59: done: 0.01494 sec","job_status":"done","queue_duration_s":0.502382,"scheduling_latency_s":0.502399,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01494,"completed_at":"2026-08-20T08:52:39.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.740128] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9a613eaa87cdafdf7a754c9","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9a613eaa87cdafdf7a754c9: start","job_status":"start","queue_duration_s":0.518594,"scheduling_latency_s":0.518611} gitlab # [ 239.752749] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9a613eaa87cdafdf7a754c9","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9a613eaa87cdafdf7a754c9: done: 0.014997 sec","job_status":"done","queue_duration_s":0.518594,"scheduling_latency_s":0.518611,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014997,"completed_at":"2026-08-20T08:52:39.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.792612] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"696f94f35036e0d3fb92909b","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-696f94f35036e0d3fb92909b: start","job_status":"start","queue_duration_s":0.534672,"scheduling_latency_s":0.534688} gitlab # [ 239.805231] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"696f94f35036e0d3fb92909b","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-696f94f35036e0d3fb92909b: done: 0.015492 sec","job_status":"done","queue_duration_s":0.534672,"scheduling_latency_s":0.534688,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015492,"completed_at":"2026-08-20T08:52:39.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.846124] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc2927487a33546ee34eb80b","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc2927487a33546ee34eb80b: start","job_status":"start","queue_duration_s":0.551292,"scheduling_latency_s":0.55131} gitlab # [ 239.858781] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc2927487a33546ee34eb80b","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc2927487a33546ee34eb80b: done: 0.014759 sec","job_status":"done","queue_duration_s":0.551292,"scheduling_latency_s":0.55131,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014759,"completed_at":"2026-08-20T08:52:39.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.898217] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff7c38e81a3d51dc0bd3ed29","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff7c38e81a3d51dc0bd3ed29: start","job_status":"start","queue_duration_s":0.567457,"scheduling_latency_s":0.567475} gitlab # [ 239.910716] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff7c38e81a3d51dc0bd3ed29","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff7c38e81a3d51dc0bd3ed29: done: 0.014693 sec","job_status":"done","queue_duration_s":0.567457,"scheduling_latency_s":0.567475,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014693,"completed_at":"2026-08-20T08:52:39.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.950625] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78db877c9ecb2f34a9cb2f50","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78db877c9ecb2f34a9cb2f50: start","job_status":"start","queue_duration_s":0.583379,"scheduling_latency_s":0.583396} gitlab # [ 239.963001] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78db877c9ecb2f34a9cb2f50","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78db877c9ecb2f34a9cb2f50: done: 0.014548 sec","job_status":"done","queue_duration_s":0.583379,"scheduling_latency_s":0.583396,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014548,"completed_at":"2026-08-20T08:52:39.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.002765] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b00a18c00d93f0219150b735","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b00a18c00d93f0219150b735: start","job_status":"start","queue_duration_s":0.599263,"scheduling_latency_s":0.59928} gitlab # [ 240.015513] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b00a18c00d93f0219150b735","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b00a18c00d93f0219150b735: done: 0.016844 sec","job_status":"done","queue_duration_s":0.599263,"scheduling_latency_s":0.59928,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016844,"completed_at":"2026-08-20T08:52:39.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.059409] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcc4cac7427fdf2b8bfd22dc","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcc4cac7427fdf2b8bfd22dc: start","job_status":"start","queue_duration_s":0.617509,"scheduling_latency_s":0.617526} gitlab # [ 240.097892] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcc4cac7427fdf2b8bfd22dc","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcc4cac7427fdf2b8bfd22dc: done: 0.014681 sec","job_status":"done","queue_duration_s":0.617509,"scheduling_latency_s":0.617526,"redis_calls":13,"redis_duration_s":0.001618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014681,"completed_at":"2026-08-20T08:52:39.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.168881] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"231d0e0637d0da75e3cb0dc7","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-231d0e0637d0da75e3cb0dc7: start","job_status":"start","queue_duration_s":0.633429,"scheduling_latency_s":0.633447} gitlab # [ 240.184665] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"231d0e0637d0da75e3cb0dc7","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-231d0e0637d0da75e3cb0dc7: done: 0.014675 sec","job_status":"done","queue_duration_s":0.633429,"scheduling_latency_s":0.633447,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014675,"completed_at":"2026-08-20T08:52:39.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.233755] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"741f2b027328900983c3d2eb","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-741f2b027328900983c3d2eb: start","job_status":"start","queue_duration_s":0.649293,"scheduling_latency_s":0.64931} gitlab # [ 240.248427] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"741f2b027328900983c3d2eb","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-741f2b027328900983c3d2eb: done: 0.014752 sec","job_status":"done","queue_duration_s":0.649293,"scheduling_latency_s":0.64931,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014752,"completed_at":"2026-08-20T08:52:39.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.289541] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d3bd7283f4c77eb596e5930","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d3bd7283f4c77eb596e5930: start","job_status":"start","queue_duration_s":0.665281,"scheduling_latency_s":0.665298} gitlab # [ 240.302180] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d3bd7283f4c77eb596e5930","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d3bd7283f4c77eb596e5930: done: 0.015676 sec","job_status":"done","queue_duration_s":0.665281,"scheduling_latency_s":0.665298,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015676,"completed_at":"2026-08-20T08:52:39.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.342110] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c84fc6d5e16399ffeacec96","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c84fc6d5e16399ffeacec96: start","job_status":"start","queue_duration_s":0.682338,"scheduling_latency_s":0.682356} gitlab # [ 240.354897] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c84fc6d5e16399ffeacec96","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c84fc6d5e16399ffeacec96: done: 0.014702 sec","job_status":"done","queue_duration_s":0.682338,"scheduling_latency_s":0.682356,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014702,"completed_at":"2026-08-20T08:52:39.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.394711] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800b607a38d23238fa108fb8","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800b607a38d23238fa108fb8: start","job_status":"start","queue_duration_s":0.698359,"scheduling_latency_s":0.698376} gitlab # [ 240.407507] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800b607a38d23238fa108fb8","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800b607a38d23238fa108fb8: done: 0.014773 sec","job_status":"done","queue_duration_s":0.698359,"scheduling_latency_s":0.698376,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014773,"completed_at":"2026-08-20T08:52:39.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.448526] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869eacdef3c580a64ca7a797","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869eacdef3c580a64ca7a797: start","job_status":"start","queue_duration_s":0.714223,"scheduling_latency_s":0.714239} gitlab # [ 240.461069] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869eacdef3c580a64ca7a797","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869eacdef3c580a64ca7a797: done: 0.015839 sec","job_status":"done","queue_duration_s":0.714223,"scheduling_latency_s":0.714239,"redis_calls":13,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015839,"completed_at":"2026-08-20T08:52:39.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.500967] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed58bb29a9f39819e56e4a3d","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed58bb29a9f39819e56e4a3d: start","job_status":"start","queue_duration_s":0.731641,"scheduling_latency_s":0.731659} gitlab # [ 240.513570] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed58bb29a9f39819e56e4a3d","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed58bb29a9f39819e56e4a3d: done: 0.015384 sec","job_status":"done","queue_duration_s":0.731641,"scheduling_latency_s":0.731659,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015384,"completed_at":"2026-08-20T08:52:39.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.553244] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d61b7bf07c04d75d1fb332b1","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d61b7bf07c04d75d1fb332b1: start","job_status":"start","queue_duration_s":0.748148,"scheduling_latency_s":0.748165} gitlab # [ 240.565868] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d61b7bf07c04d75d1fb332b1","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d61b7bf07c04d75d1fb332b1: done: 0.032079 sec","job_status":"done","queue_duration_s":0.748148,"scheduling_latency_s":0.748165,"redis_calls":13,"redis_duration_s":0.003334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032079,"completed_at":"2026-08-20T08:52:39.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.605696] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ce128fe12a8d2eee721fa9e","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ce128fe12a8d2eee721fa9e: start","job_status":"start","queue_duration_s":0.783047,"scheduling_latency_s":0.783079} gitlab # [ 240.618112] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ce128fe12a8d2eee721fa9e","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ce128fe12a8d2eee721fa9e: done: 0.041127 sec","job_status":"done","queue_duration_s":0.783047,"scheduling_latency_s":0.783079,"redis_calls":13,"redis_duration_s":0.003858,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002681,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041127,"completed_at":"2026-08-20T08:52:39.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.659731] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac5fb87f46cca72e03e791e","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac5fb87f46cca72e03e791e: start","job_status":"start","queue_duration_s":0.82783,"scheduling_latency_s":0.827871} gitlab # [ 240.672539] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac5fb87f46cca72e03e791e","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac5fb87f46cca72e03e791e: done: 0.043756 sec","job_status":"done","queue_duration_s":0.82783,"scheduling_latency_s":0.827871,"redis_calls":13,"redis_duration_s":0.00398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043756,"completed_at":"2026-08-20T08:52:39.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.713201] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3bf1ac0613382d640439b8f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3bf1ac0613382d640439b8f: start","job_status":"start","queue_duration_s":0.874837,"scheduling_latency_s":0.874875} gitlab # [ 240.725937] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3bf1ac0613382d640439b8f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3bf1ac0613382d640439b8f: done: 0.041769 sec","job_status":"done","queue_duration_s":0.874837,"scheduling_latency_s":0.874875,"redis_calls":13,"redis_duration_s":0.004071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002651,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041769,"completed_at":"2026-08-20T08:52:39.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.765433] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22e128ab450e361113b3d31f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22e128ab450e361113b3d31f: start","job_status":"start","queue_duration_s":0.919358,"scheduling_latency_s":0.919378} gitlab # [ 240.778092] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22e128ab450e361113b3d31f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22e128ab450e361113b3d31f: done: 0.030097 sec","job_status":"done","queue_duration_s":0.919358,"scheduling_latency_s":0.919378,"redis_calls":13,"redis_duration_s":0.002478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030097,"completed_at":"2026-08-20T08:52:39.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.817677] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b6c0380aac823605c1c79f5","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b6c0380aac823605c1c79f5: start","job_status":"start","queue_duration_s":0.952879,"scheduling_latency_s":0.952899} gitlab # [ 240.830373] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b6c0380aac823605c1c79f5","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b6c0380aac823605c1c79f5: done: 0.042424 sec","job_status":"done","queue_duration_s":0.952879,"scheduling_latency_s":0.952899,"redis_calls":13,"redis_duration_s":0.003823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002591,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042424,"completed_at":"2026-08-20T08:52:39.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.871199] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3eb0d9910430d67312673a9","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3eb0d9910430d67312673a9: start","job_status":"start","queue_duration_s":0.999021,"scheduling_latency_s":0.999043} gitlab # [ 240.884152] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3eb0d9910430d67312673a9","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3eb0d9910430d67312673a9: done: 0.044423 sec","job_status":"done","queue_duration_s":0.999021,"scheduling_latency_s":0.999043,"redis_calls":13,"redis_duration_s":0.003836,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044423,"completed_at":"2026-08-20T08:52:39.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.924477] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4d968619c43c7df9698370f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4d968619c43c7df9698370f: start","job_status":"start","queue_duration_s":1.047145,"scheduling_latency_s":1.047171} gitlab # [ 240.936889] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4d968619c43c7df9698370f","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4d968619c43c7df9698370f: done: 0.020929 sec","job_status":"done","queue_duration_s":1.047145,"scheduling_latency_s":1.047171,"redis_calls":13,"redis_duration_s":0.001768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020929,"completed_at":"2026-08-20T08:52:39.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.976657] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e23799b846513457af4571f6","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e23799b846513457af4571f6: start","job_status":"start","queue_duration_s":1.06923,"scheduling_latency_s":1.069247} gitlab # [ 240.989103] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e23799b846513457af4571f6","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e23799b846513457af4571f6: done: 0.017341 sec","job_status":"done","queue_duration_s":1.06923,"scheduling_latency_s":1.069247,"redis_calls":13,"redis_duration_s":0.001733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001161,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017341,"completed_at":"2026-08-20T08:52:39.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.029229] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c692e690e78cb99a28f672","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c692e690e78cb99a28f672: start","job_status":"start","queue_duration_s":1.089077,"scheduling_latency_s":1.089101} gitlab # [ 241.043004] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81c692e690e78cb99a28f672","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81c692e690e78cb99a28f672: done: 0.043088 sec","job_status":"done","queue_duration_s":1.089077,"scheduling_latency_s":1.089101,"redis_calls":13,"redis_duration_s":0.003643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043088,"completed_at":"2026-08-20T08:52:39.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.082969] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f3c9e9af9c746b7bcf7023c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f3c9e9af9c746b7bcf7023c: start","job_status":"start","queue_duration_s":1.135283,"scheduling_latency_s":1.135338} gitlab # [ 241.095812] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f3c9e9af9c746b7bcf7023c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f3c9e9af9c746b7bcf7023c: done: 0.046519 sec","job_status":"done","queue_duration_s":1.135283,"scheduling_latency_s":1.135338,"redis_calls":13,"redis_duration_s":0.0037610000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046519,"completed_at":"2026-08-20T08:52:39.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.135881] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:39.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d177132de673eabec86e5d99","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d177132de673eabec86e5d99: start","job_status":"start","queue_duration_s":1.18463,"scheduling_latency_s":1.184687} gitlab # [ 241.148877] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d177132de673eabec86e5d99","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d177132de673eabec86e5d99: done: 0.028094 sec","job_status":"done","queue_duration_s":1.18463,"scheduling_latency_s":1.184687,"redis_calls":13,"redis_duration_s":0.002336,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028094,"completed_at":"2026-08-20T08:52:40.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.188813] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e263f506ea2464794dfc2d1c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e263f506ea2464794dfc2d1c: start","job_status":"start","queue_duration_s":1.214137,"scheduling_latency_s":1.214158} gitlab # [ 241.201515] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e263f506ea2464794dfc2d1c","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e263f506ea2464794dfc2d1c: done: 0.02701 sec","job_status":"done","queue_duration_s":1.214137,"scheduling_latency_s":1.214158,"redis_calls":13,"redis_duration_s":0.002365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001477,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02701,"completed_at":"2026-08-20T08:52:40.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.241973] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcadfbac131498d4a3e4beb2","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcadfbac131498d4a3e4beb2: start","job_status":"start","queue_duration_s":1.244406,"scheduling_latency_s":1.244464} gitlab # [ 241.256121] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcadfbac131498d4a3e4beb2","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcadfbac131498d4a3e4beb2: done: 0.04554 sec","job_status":"done","queue_duration_s":1.244406,"scheduling_latency_s":1.244464,"redis_calls":13,"redis_duration_s":0.004019,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002677,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04554,"completed_at":"2026-08-20T08:52:40.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.296345] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94bcc178c0e4b69a76187dd8","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94bcc178c0e4b69a76187dd8: start","job_status":"start","queue_duration_s":1.293611,"scheduling_latency_s":1.293674} gitlab # [ 241.308885] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94bcc178c0e4b69a76187dd8","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94bcc178c0e4b69a76187dd8: done: 0.045162 sec","job_status":"done","queue_duration_s":1.293611,"scheduling_latency_s":1.293674,"redis_calls":13,"redis_duration_s":0.003836,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045162,"completed_at":"2026-08-20T08:52:40.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.349029] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d26034d15df1fad8ea0b2a","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d26034d15df1fad8ea0b2a: start","job_status":"start","queue_duration_s":1.342325,"scheduling_latency_s":1.342351} gitlab # [ 241.361697] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5d26034d15df1fad8ea0b2a","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5d26034d15df1fad8ea0b2a: done: 0.050851 sec","job_status":"done","queue_duration_s":1.342325,"scheduling_latency_s":1.342351,"redis_calls":13,"redis_duration_s":0.008479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.050851,"completed_at":"2026-08-20T08:52:40.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.400922] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e7520aedf6ae84858fff9e8","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e7520aedf6ae84858fff9e8: start","job_status":"start","queue_duration_s":1.396241,"scheduling_latency_s":1.396263} gitlab # [ 241.413448] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e7520aedf6ae84858fff9e8","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e7520aedf6ae84858fff9e8: done: 0.053565 sec","job_status":"done","queue_duration_s":1.396241,"scheduling_latency_s":1.396263,"redis_calls":13,"redis_duration_s":0.0046099999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053565,"completed_at":"2026-08-20T08:52:40.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.453912] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c06fcfa4f76e5bb31caa6f49","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c06fcfa4f76e5bb31caa6f49: start","job_status":"start","queue_duration_s":1.453248,"scheduling_latency_s":1.453283} gitlab # [ 241.466345] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:52:40.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c06fcfa4f76e5bb31caa6f49","created_at":"2026-08-20T08:52:38.712Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-fdbe14b9cb654a26","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6c78e82acdfa40df95c36aa7e87443a0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:38.792Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c06fcfa4f76e5bb31caa6f49: done: 0.046744 sec","job_status":"done","queue_duration_s":1.453248,"scheduling_latency_s":1.453283,"redis_calls":13,"redis_duration_s":0.003778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002385,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046744,"completed_at":"2026-08-20T08:52:40.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 265.377913] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b348cba10463fab428fef5fb","created_at":"2026-08-20T08:53:06.122Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f99950ccf87b1094acf2182d1b384e7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.138Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b348cba10463fab428fef5fb: start","job_status":"start","queue_duration_s":0.008138,"scheduling_latency_s":0.008186} gitlab # [ 265.448724] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b348cba10463fab428fef5fb","created_at":"2026-08-20T08:53:06.122Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f99950ccf87b1094acf2182d1b384e7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.138Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b348cba10463fab428fef5fb: done: 0.071384 sec","job_status":"done","queue_duration_s":0.008138,"scheduling_latency_s":0.008186,"redis_calls":7,"redis_duration_s":0.014077,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008661,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.071384,"completed_at":"2026-08-20T08:53:06.217Z","load_balancing_strategy":"primary","db_duration_s":0.013525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 265.535448] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ec951eefd0f39dbee2d98514","created_at":"2026-08-20T08:53:06.150Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47af74f1ab01469ba4d56f71040ac05f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.155Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ec951eefd0f39dbee2d98514: start","job_status":"start","queue_duration_s":0.085479,"scheduling_latency_s":0.085533} gitlab # [ 265.804112] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ec951eefd0f39dbee2d98514","created_at":"2026-08-20T08:53:06.150Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47af74f1ab01469ba4d56f71040ac05f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.155Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ec951eefd0f39dbee2d98514: done: 0.332157 sec","job_status":"done","queue_duration_s":0.085479,"scheduling_latency_s":0.085533,"redis_calls":9,"redis_duration_s":0.026758,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.021574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.01987352,"exclusive_lock_hold_duration_s":0.1377431,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.332157,"completed_at":"2026-08-20T08:53:06.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.15593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 265.904766] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d9003ce4e0a1b16f0cf24150","created_at":"2026-08-20T08:53:06.174Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dcffaf47f2bf9cc522d4f91c2ace6cf4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.181Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d9003ce4e0a1b16f0cf24150: start","job_status":"start","queue_duration_s":0.393947,"scheduling_latency_s":0.393971} gitlab # [ 265.924871] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d9003ce4e0a1b16f0cf24150","created_at":"2026-08-20T08:53:06.174Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dcffaf47f2bf9cc522d4f91c2ace6cf4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.181Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d9003ce4e0a1b16f0cf24150: done: 0.040293 sec","job_status":"done","queue_duration_s":0.393947,"scheduling_latency_s":0.393971,"redis_calls":9,"redis_duration_s":0.003546,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00139446,"exclusive_lock_hold_duration_s":0.0059194,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.040293,"completed_at":"2026-08-20T08:53:06.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 265.975119] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"39ec98bb14742350d5ff784e","created_at":"2026-08-20T08:53:06.202Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cf3641ca2aa29c000ecad46086bbf61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.208Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-39ec98bb14742350d5ff784e: start","job_status":"start","queue_duration_s":0.410623,"scheduling_latency_s":0.41066} gitlab # [ 265.991017] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.638Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 265.994977] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"39ec98bb14742350d5ff784e","created_at":"2026-08-20T08:53:06.202Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cf3641ca2aa29c000ecad46086bbf61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.208Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-39ec98bb14742350d5ff784e: done: 0.087816 sec","job_status":"done","queue_duration_s":0.410623,"scheduling_latency_s":0.41066,"redis_calls":7,"redis_duration_s":0.0018900000000000002,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087816,"completed_at":"2026-08-20T08:53:06.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.036277] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c32ef9ca9a6fbb93064e294a","created_at":"2026-08-20T08:53:06.239Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"265921089c9bb50fbb53f7b5e47ae7bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:53:06.247Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c32ef9ca9a6fbb93064e294a: start","job_status":"start","queue_duration_s":0.465087,"scheduling_latency_s":0.465133} gitlab # [ 266.049426] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.737Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 266.052622] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c32ef9ca9a6fbb93064e294a","created_at":"2026-08-20T08:53:06.239Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"265921089c9bb50fbb53f7b5e47ae7bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:53:06.247Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c32ef9ca9a6fbb93064e294a: done: 0.051143 sec","job_status":"done","queue_duration_s":0.465087,"scheduling_latency_s":0.465133,"redis_calls":7,"redis_duration_s":0.0026550000000000002,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051143,"completed_at":"2026-08-20T08:53:06.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.092313] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:06.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fc22075dbd10f2423a650919","created_at":"2026-08-20T08:53:06.255Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c844cfb932b12c5b0a1b25f908881abb","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.260Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fc22075dbd10f2423a650919: start","job_status":"start","queue_duration_s":0.507895,"scheduling_latency_s":0.507944} gitlab # [ 266.427618] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fc22075dbd10f2423a650919","created_at":"2026-08-20T08:53:06.255Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c844cfb932b12c5b0a1b25f908881abb","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.260Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fc22075dbd10f2423a650919: done: 0.428735 sec","job_status":"done","queue_duration_s":0.507895,"scheduling_latency_s":0.507944,"redis_calls":562,"redis_duration_s":0.10521,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.103726,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.345181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.428735,"completed_at":"2026-08-20T08:53:07.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.469907] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bd9e8ea78a4fba9aeeba0b62","created_at":"2026-08-20T08:53:06.266Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7df0aaefdbfbde2386b31879c657a985","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:53:06.271Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bd9e8ea78a4fba9aeeba0b62: start","job_status":"start","queue_duration_s":0.927225,"scheduling_latency_s":0.927257} gitlab # [ 266.483599] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.207Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 266.487540] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bd9e8ea78a4fba9aeeba0b62","created_at":"2026-08-20T08:53:06.266Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7df0aaefdbfbde2386b31879c657a985","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:53:06.271Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bd9e8ea78a4fba9aeeba0b62: done: 0.015821 sec","job_status":"done","queue_duration_s":0.927225,"scheduling_latency_s":0.927257,"redis_calls":7,"redis_duration_s":0.001206,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015821,"completed_at":"2026-08-20T08:53:07.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.527151] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5825034fe428a04275a76502","created_at":"2026-08-20T08:53:06.279Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ef124dc193da5c947d72a34dcca0386","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.283Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5825034fe428a04275a76502: start","job_status":"start","queue_duration_s":0.932139,"scheduling_latency_s":0.932166} gitlab # [ 266.773523] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5825034fe428a04275a76502","created_at":"2026-08-20T08:53:06.279Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ef124dc193da5c947d72a34dcca0386","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.283Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5825034fe428a04275a76502: done: 0.327361 sec","job_status":"done","queue_duration_s":0.932139,"scheduling_latency_s":0.932166,"redis_calls":9,"redis_duration_s":0.00234,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.043,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.266494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00067096,"exclusive_lock_hold_duration_s":0.3092,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.327361,"completed_at":"2026-08-20T08:53:07.542Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.073751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.870130] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8877444bc3aa276ce9d1e9ab","created_at":"2026-08-20T08:53:06.319Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"902f0bc66d46ef30ca491029883e1c58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.323Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8877444bc3aa276ce9d1e9ab: start","job_status":"start","queue_duration_s":1.221801,"scheduling_latency_s":1.221824} gitlab # [ 266.898712] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8877444bc3aa276ce9d1e9ab","created_at":"2026-08-20T08:53:06.319Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"902f0bc66d46ef30ca491029883e1c58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.323Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8877444bc3aa276ce9d1e9ab: done: 0.014423 sec","job_status":"done","queue_duration_s":1.221801,"scheduling_latency_s":1.221824,"redis_calls":7,"redis_duration_s":0.001767,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014423,"completed_at":"2026-08-20T08:53:07.559Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.950166] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cc6419b13e89be43fb3d169f","created_at":"2026-08-20T08:53:06.353Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbfcea58e32e20ce72bb79c3376a22d5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.363Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cc6419b13e89be43fb3d169f: start","job_status":"start","queue_duration_s":1.197549,"scheduling_latency_s":1.197565} gitlab # [ 266.966634] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cc6419b13e89be43fb3d169f","created_at":"2026-08-20T08:53:06.353Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbfcea58e32e20ce72bb79c3376a22d5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.363Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cc6419b13e89be43fb3d169f: done: 0.0368 sec","job_status":"done","queue_duration_s":1.197549,"scheduling_latency_s":1.197565,"redis_calls":10,"redis_duration_s":0.003733,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002316,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01014252,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.0368,"completed_at":"2026-08-20T08:53:07.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004298,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 267.010006] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e5346f6ddfc2de35ac489204","created_at":"2026-08-20T08:53:06.370Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.374Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e5346f6ddfc2de35ac489204: start","job_status":"start","queue_duration_s":1.227012,"scheduling_latency_s":1.227061} gitlab # [ 267.023711] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e5346f6ddfc2de35ac489204","created_at":"2026-08-20T08:53:06.370Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.374Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e5346f6ddfc2de35ac489204: done: 0.060076 sec","job_status":"done","queue_duration_s":1.227012,"scheduling_latency_s":1.227061,"redis_calls":14,"redis_duration_s":0.00467,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000636,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00316,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060076,"completed_at":"2026-08-20T08:53:07.661Z","load_balancing_strategy":"primary","db_duration_s":0.00208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.065840] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9c3849b35a5f376ef5d6885f","created_at":"2026-08-20T08:53:06.381Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c2a70c8e2fb84aa9900eb5a5a83b521","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.395Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9c3849b35a5f376ef5d6885f: start","job_status":"start","queue_duration_s":1.268814,"scheduling_latency_s":1.26885} gitlab # [ 267.080608] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.678Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 267.083865] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9c3849b35a5f376ef5d6885f","created_at":"2026-08-20T08:53:06.381Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c2a70c8e2fb84aa9900eb5a5a83b521","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.395Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9c3849b35a5f376ef5d6885f: done: 0.023967 sec","job_status":"done","queue_duration_s":1.268814,"scheduling_latency_s":1.26885,"redis_calls":7,"redis_duration_s":0.00224,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023967,"completed_at":"2026-08-20T08:53:07.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.125827] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"986c52ac5d3c781ff25d5280","created_at":"2026-08-20T08:53:06.430Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51c654c6077f2122cf02c70507e50b22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.437Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-986c52ac5d3c781ff25d5280: start","job_status":"start","queue_duration_s":1.252526,"scheduling_latency_s":1.252552} gitlab # [ 267.140525] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"986c52ac5d3c781ff25d5280","created_at":"2026-08-20T08:53:06.430Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51c654c6077f2122cf02c70507e50b22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.437Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-986c52ac5d3c781ff25d5280: done: 0.019444 sec","job_status":"done","queue_duration_s":1.252526,"scheduling_latency_s":1.252552,"redis_calls":7,"redis_duration_s":0.00196,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019444,"completed_at":"2026-08-20T08:53:07.709Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.183497] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ba382014e6adde113948dd1e","created_at":"2026-08-20T08:53:06.449Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fe02f5b7de8f3522c1ea9f0df2d9eb7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.454Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ba382014e6adde113948dd1e: start","job_status":"start","queue_duration_s":1.25693,"scheduling_latency_s":1.256951} gitlab # [ 267.224344] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ba382014e6adde113948dd1e","created_at":"2026-08-20T08:53:06.449Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fe02f5b7de8f3522c1ea9f0df2d9eb7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.454Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ba382014e6adde113948dd1e: done: 0.024859 sec","job_status":"done","queue_duration_s":1.25693,"scheduling_latency_s":1.256951,"redis_calls":9,"redis_duration_s":0.002731,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062912,"exclusive_lock_hold_duration_s":0.0076227,"duration_s":0.024859,"completed_at":"2026-08-20T08:53:07.736Z","load_balancing_strategy":"primary","db_duration_s":0.004236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.290635] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d47a6a74a3b0d819d31989a8","created_at":"2026-08-20T08:53:06.475Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63ef16c9456bbc4de41c852cb867f1f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.478Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d47a6a74a3b0d819d31989a8: start","job_status":"start","queue_duration_s":1.259187,"scheduling_latency_s":1.259208} gitlab # [ 267.306719] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.746Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 267.310460] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d47a6a74a3b0d819d31989a8","created_at":"2026-08-20T08:53:06.475Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"63ef16c9456bbc4de41c852cb867f1f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.478Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d47a6a74a3b0d819d31989a8: done: 0.01469 sec","job_status":"done","queue_duration_s":1.259187,"scheduling_latency_s":1.259208,"redis_calls":7,"redis_duration_s":0.001712,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01469,"completed_at":"2026-08-20T08:53:07.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.350892] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"186d2822e8a7e6ddb78b91e4","created_at":"2026-08-20T08:53:06.518Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2dad6b2a1331da9c2f7596842229507","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.523Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-186d2822e8a7e6ddb78b91e4: start","job_status":"start","queue_duration_s":1.230775,"scheduling_latency_s":1.230799} gitlab # [ 267.365479] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.763Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 267.369763] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"186d2822e8a7e6ddb78b91e4","created_at":"2026-08-20T08:53:06.518Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2dad6b2a1331da9c2f7596842229507","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.523Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-186d2822e8a7e6ddb78b91e4: done: 0.015076 sec","job_status":"done","queue_duration_s":1.230775,"scheduling_latency_s":1.230799,"redis_calls":7,"redis_duration_s":0.001875,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015076,"completed_at":"2026-08-20T08:53:07.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.410586] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.771Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"85692278480726d777ca7d7b","created_at":"2026-08-20T08:53:06.534Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9508eec09ebed002931f92ecc8aec5b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.537Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-85692278480726d777ca7d7b: start","job_status":"start","queue_duration_s":1.233437,"scheduling_latency_s":1.233455} gitlab # [ 267.425322] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.804Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"85692278480726d777ca7d7b","created_at":"2026-08-20T08:53:06.534Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9508eec09ebed002931f92ecc8aec5b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.537Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-85692278480726d777ca7d7b: done: 0.033113 sec","job_status":"done","queue_duration_s":1.233437,"scheduling_latency_s":1.233455,"redis_calls":7,"redis_duration_s":0.002198,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001589,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033113,"completed_at":"2026-08-20T08:53:07.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.466223] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"2989d195b6d40fc6d19fcbce","created_at":"2026-08-20T08:53:06.550Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd951fcda5ffebf6e408cb78a7e96cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.642Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-2989d195b6d40fc6d19fcbce: start","job_status":"start","queue_duration_s":1.163263,"scheduling_latency_s":1.163283} gitlab # [ 267.480227] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"2989d195b6d40fc6d19fcbce","created_at":"2026-08-20T08:53:06.550Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd951fcda5ffebf6e408cb78a7e96cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.642Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-2989d195b6d40fc6d19fcbce: done: 0.043658 sec","job_status":"done","queue_duration_s":1.163263,"scheduling_latency_s":1.163283,"redis_calls":20,"redis_duration_s":0.006104,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003247,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000344,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001713,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034244,"duration_s":0.043658,"completed_at":"2026-08-20T08:53:07.849Z","load_balancing_strategy":"primary","db_duration_s":0.002664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.523029] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1a52e313b74015cb43ff8c15","created_at":"2026-08-20T08:53:06.664Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.677Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1a52e313b74015cb43ff8c15: start","job_status":"start","queue_duration_s":1.173897,"scheduling_latency_s":1.173915} gitlab # [ 267.536522] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1a52e313b74015cb43ff8c15","created_at":"2026-08-20T08:53:06.664Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.677Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1a52e313b74015cb43ff8c15: done: 0.091948 sec","job_status":"done","queue_duration_s":1.173897,"scheduling_latency_s":1.173915,"redis_calls":60,"redis_duration_s":0.014866,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000827,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013346,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091948,"completed_at":"2026-08-20T08:53:07.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.578538] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ae82797427bbf78b0d9faeba","created_at":"2026-08-20T08:53:06.704Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d640e10dca7c537b937d9853aa54d44a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.716Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ae82797427bbf78b0d9faeba: start","job_status":"start","queue_duration_s":1.228394,"scheduling_latency_s":1.228415} gitlab # [ 267.592559] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ae82797427bbf78b0d9faeba","created_at":"2026-08-20T08:53:06.704Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d640e10dca7c537b937d9853aa54d44a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.716Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ae82797427bbf78b0d9faeba: done: 0.018256 sec","job_status":"done","queue_duration_s":1.228394,"scheduling_latency_s":1.228415,"redis_calls":7,"redis_duration_s":0.0032960000000000003,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018256,"completed_at":"2026-08-20T08:53:07.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.632664] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"447a49324e642fdd2ee8f74d","created_at":"2026-08-20T08:53:06.754Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22b96f982222ae118e8a6eee7edd41ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:53:06.760Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-447a49324e642fdd2ee8f74d: start","job_status":"start","queue_duration_s":1.203743,"scheduling_latency_s":1.203764} gitlab # [ 267.645745] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.985Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"447a49324e642fdd2ee8f74d","created_at":"2026-08-20T08:53:06.754Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22b96f982222ae118e8a6eee7edd41ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:53:06.760Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-447a49324e642fdd2ee8f74d: done: 0.021396 sec","job_status":"done","queue_duration_s":1.203743,"scheduling_latency_s":1.203764,"redis_calls":7,"redis_duration_s":0.001099,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021396,"completed_at":"2026-08-20T08:53:07.985Z","load_balancing_strategy":"primary","db_duration_s":0.00176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.684642] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:07.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"bb928db806832cc37aa9519d","created_at":"2026-08-20T08:53:06.787Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2db0638f508a325dfc0942f4494cdf8e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.802Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-bb928db806832cc37aa9519d: start","job_status":"start","queue_duration_s":1.184453,"scheduling_latency_s":1.18447} gitlab # [ 267.699178] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"bb928db806832cc37aa9519d","created_at":"2026-08-20T08:53:06.787Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2db0638f508a325dfc0942f4494cdf8e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.802Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-bb928db806832cc37aa9519d: done: 0.040027 sec","job_status":"done","queue_duration_s":1.184453,"scheduling_latency_s":1.18447,"redis_calls":9,"redis_duration_s":0.001869,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073086,"exclusive_lock_hold_duration_s":0.0189158,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.040027,"completed_at":"2026-08-20T08:53:08.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.741955] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"b3717301df3d24c38bcd53df","created_at":"2026-08-20T08:53:06.899Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"122eaa23da4d7e3377435d1d6bf9652a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.920Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-b3717301df3d24c38bcd53df: start","job_status":"start","queue_duration_s":1.107349,"scheduling_latency_s":1.107367} gitlab # [ 267.755088] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"b3717301df3d24c38bcd53df","created_at":"2026-08-20T08:53:06.899Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-a1bd1ed71b03454b","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"122eaa23da4d7e3377435d1d6bf9652a","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:06.920Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-b3717301df3d24c38bcd53df: done: 0.114204 sec","job_status":"done","queue_duration_s":1.107349,"scheduling_latency_s":1.107367,"redis_calls":12,"redis_duration_s":0.003553,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060434,"exclusive_lock_hold_duration_s":0.01423116,"duration_s":0.114204,"completed_at":"2026-08-20T08:53:08.142Z","load_balancing_strategy":"primary","db_duration_s":0.007853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.797167] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.143Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"38a8f144a5c0d0e8f02a69e5","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-38a8f144a5c0d0e8f02a69e5: start","job_status":"start","queue_duration_s":0.494636,"scheduling_latency_s":0.494652} gitlab # [ 267.809564] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.156Z","message":"No existing merge request to be cleaned up."} gitlab # [ 267.811199] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.165Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"38a8f144a5c0d0e8f02a69e5","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-38a8f144a5c0d0e8f02a69e5: done: 0.021973 sec","job_status":"done","queue_duration_s":0.494636,"scheduling_latency_s":0.494652,"redis_calls":10,"redis_duration_s":0.0025789999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021973,"completed_at":"2026-08-20T08:53:08.165Z","load_balancing_strategy":"primary","db_duration_s":0.003175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.850165] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.167Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a6a622739ba188ad1177762","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a6a622739ba188ad1177762: start","job_status":"start","queue_duration_s":0.518059,"scheduling_latency_s":0.518075} gitlab # [ 267.862292] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.179Z","message":"No existing merge request to be cleaned up."} gitlab # [ 267.863935] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.189Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a6a622739ba188ad1177762","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a6a622739ba188ad1177762: done: 0.021918 sec","job_status":"done","queue_duration_s":0.518059,"scheduling_latency_s":0.518075,"redis_calls":10,"redis_duration_s":0.002631,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021918,"completed_at":"2026-08-20T08:53:08.189Z","load_balancing_strategy":"primary","db_duration_s":0.00272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.902897] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.190Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8a020acf26270a3f69e9f56c","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8a020acf26270a3f69e9f56c: start","job_status":"start","queue_duration_s":0.541405,"scheduling_latency_s":0.541421} gitlab # [ 267.915229] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.202Z","message":"No existing merge request to be cleaned up."} gitlab # [ 267.916936] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.210Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8a020acf26270a3f69e9f56c","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8a020acf26270a3f69e9f56c: done: 0.020319 sec","job_status":"done","queue_duration_s":0.541405,"scheduling_latency_s":0.541421,"redis_calls":10,"redis_duration_s":0.002425,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001439,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020319,"completed_at":"2026-08-20T08:53:08.210Z","load_balancing_strategy":"primary","db_duration_s":0.002503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.955799] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.212Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"679fe13dee5feea34f787f85","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-679fe13dee5feea34f787f85: start","job_status":"start","queue_duration_s":0.56329,"scheduling_latency_s":0.563307} gitlab # [ 267.968525] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.224Z","message":"No existing merge request to be cleaned up."} gitlab # [ 267.970200] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.233Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"679fe13dee5feea34f787f85","created_at":"2026-08-20T08:53:07.625Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-e48238bb2d914260","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2a526e65023696ee1e3a0856290c415a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.649Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-679fe13dee5feea34f787f85: done: 0.020981 sec","job_status":"done","queue_duration_s":0.56329,"scheduling_latency_s":0.563307,"redis_calls":10,"redis_duration_s":0.002516,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001427,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020981,"completed_at":"2026-08-20T08:53:08.233Z","load_balancing_strategy":"primary","db_duration_s":0.002516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.010044] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"312c9517746c6812f32612eb","created_at":"2026-08-20T08:53:07.830Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-ff84e92e6cd14738","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"dd951fcda5ffebf6e408cb78a7e96cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.841Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-312c9517746c6812f32612eb: start","job_status":"start","queue_duration_s":0.393472,"scheduling_latency_s":0.393488} gitlab # [ 268.023146] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"312c9517746c6812f32612eb","created_at":"2026-08-20T08:53:07.830Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-ff84e92e6cd14738","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"dd951fcda5ffebf6e408cb78a7e96cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.841Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-312c9517746c6812f32612eb: done: 0.049197 sec","job_status":"done","queue_duration_s":0.393472,"scheduling_latency_s":0.393488,"redis_calls":13,"redis_duration_s":0.003908,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001752,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046682,"duration_s":0.049197,"completed_at":"2026-08-20T08:53:08.284Z","load_balancing_strategy":"primary","db_duration_s":0.016852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.064784] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7db37db052c03b3d3952813","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7db37db052c03b3d3952813: start","job_status":"start","queue_duration_s":0.351671,"scheduling_latency_s":0.351689} gitlab # [ 268.076962] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7db37db052c03b3d3952813","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7db37db052c03b3d3952813: done: 0.014966 sec","job_status":"done","queue_duration_s":0.351671,"scheduling_latency_s":0.351689,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014966,"completed_at":"2026-08-20T08:53:08.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.116818] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f217dad9f3d30e401520c93a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f217dad9f3d30e401520c93a: start","job_status":"start","queue_duration_s":0.368592,"scheduling_latency_s":0.368609} gitlab # [ 268.129155] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f217dad9f3d30e401520c93a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f217dad9f3d30e401520c93a: done: 0.016344 sec","job_status":"done","queue_duration_s":0.368592,"scheduling_latency_s":0.368609,"redis_calls":13,"redis_duration_s":0.0015799999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016344,"completed_at":"2026-08-20T08:53:08.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.168909] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41c1e5a0ba99f0346246ff90","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41c1e5a0ba99f0346246ff90: start","job_status":"start","queue_duration_s":0.386277,"scheduling_latency_s":0.386295} gitlab # [ 268.182433] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41c1e5a0ba99f0346246ff90","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41c1e5a0ba99f0346246ff90: done: 0.015693 sec","job_status":"done","queue_duration_s":0.386277,"scheduling_latency_s":0.386295,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015693,"completed_at":"2026-08-20T08:53:08.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.222669] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f035f2ab02ee475b8db474a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f035f2ab02ee475b8db474a: start","job_status":"start","queue_duration_s":0.403119,"scheduling_latency_s":0.403137} gitlab # [ 268.235106] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f035f2ab02ee475b8db474a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f035f2ab02ee475b8db474a: done: 0.015198 sec","job_status":"done","queue_duration_s":0.403119,"scheduling_latency_s":0.403137,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015198,"completed_at":"2026-08-20T08:53:08.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.275056] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e59a9adc9cc47d887701dedb","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e59a9adc9cc47d887701dedb: start","job_status":"start","queue_duration_s":0.419485,"scheduling_latency_s":0.419502} gitlab # [ 268.287775] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e59a9adc9cc47d887701dedb","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e59a9adc9cc47d887701dedb: done: 0.01523 sec","job_status":"done","queue_duration_s":0.419485,"scheduling_latency_s":0.419502,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01523,"completed_at":"2026-08-20T08:53:08.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.327530] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"979358085bf8dc7d92ed032b","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-979358085bf8dc7d92ed032b: start","job_status":"start","queue_duration_s":0.436714,"scheduling_latency_s":0.436731} gitlab # [ 268.340200] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"979358085bf8dc7d92ed032b","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-979358085bf8dc7d92ed032b: done: 0.0197 sec","job_status":"done","queue_duration_s":0.436714,"scheduling_latency_s":0.436731,"redis_calls":13,"redis_duration_s":0.002983,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0197,"completed_at":"2026-08-20T08:53:08.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.379171] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7b7101612305feee9cbc450","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7b7101612305feee9cbc450: start","job_status":"start","queue_duration_s":0.457619,"scheduling_latency_s":0.457637} gitlab # [ 268.392774] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7b7101612305feee9cbc450","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7b7101612305feee9cbc450: done: 0.015001 sec","job_status":"done","queue_duration_s":0.457619,"scheduling_latency_s":0.457637,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-08-20T08:53:08.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.432087] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c01d35dcc331a8446ef84c1","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c01d35dcc331a8446ef84c1: start","job_status":"start","queue_duration_s":0.473708,"scheduling_latency_s":0.473725} gitlab # [ 268.444288] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c01d35dcc331a8446ef84c1","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c01d35dcc331a8446ef84c1: done: 0.014738 sec","job_status":"done","queue_duration_s":0.473708,"scheduling_latency_s":0.473725,"redis_calls":13,"redis_duration_s":0.0014819999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014738,"completed_at":"2026-08-20T08:53:08.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.484218] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"199d5222ee5e46b7dae3c86a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-199d5222ee5e46b7dae3c86a: start","job_status":"start","queue_duration_s":0.490269,"scheduling_latency_s":0.490287} gitlab # [ 268.496336] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"199d5222ee5e46b7dae3c86a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-199d5222ee5e46b7dae3c86a: done: 0.015159 sec","job_status":"done","queue_duration_s":0.490269,"scheduling_latency_s":0.490287,"redis_calls":13,"redis_duration_s":0.001735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015159,"completed_at":"2026-08-20T08:53:08.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.535878] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9ab63a9d3220b228eb4db38","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9ab63a9d3220b228eb4db38: start","job_status":"start","queue_duration_s":0.506516,"scheduling_latency_s":0.506532} gitlab # [ 268.548457] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9ab63a9d3220b228eb4db38","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9ab63a9d3220b228eb4db38: done: 0.01536 sec","job_status":"done","queue_duration_s":0.506516,"scheduling_latency_s":0.506532,"redis_calls":13,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01536,"completed_at":"2026-08-20T08:53:08.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.588243] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6216148e003688a7a3307d38","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6216148e003688a7a3307d38: start","job_status":"start","queue_duration_s":0.523046,"scheduling_latency_s":0.523064} gitlab # [ 268.601674] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6216148e003688a7a3307d38","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6216148e003688a7a3307d38: done: 0.015848 sec","job_status":"done","queue_duration_s":0.523046,"scheduling_latency_s":0.523064,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015848,"completed_at":"2026-08-20T08:53:08.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.640942] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f8b7cd493c3100abdde6077","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f8b7cd493c3100abdde6077: start","job_status":"start","queue_duration_s":0.540041,"scheduling_latency_s":0.540057} gitlab # [ 268.653270] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f8b7cd493c3100abdde6077","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f8b7cd493c3100abdde6077: done: 0.015739 sec","job_status":"done","queue_duration_s":0.540041,"scheduling_latency_s":0.540057,"redis_calls":13,"redis_duration_s":0.001403,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015739,"completed_at":"2026-08-20T08:53:08.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.692619] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0b8e417c39544806e6fefd7","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0b8e417c39544806e6fefd7: start","job_status":"start","queue_duration_s":0.556921,"scheduling_latency_s":0.556938} gitlab # [ 268.704906] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0b8e417c39544806e6fefd7","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0b8e417c39544806e6fefd7: done: 0.015242 sec","job_status":"done","queue_duration_s":0.556921,"scheduling_latency_s":0.556938,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015242,"completed_at":"2026-08-20T08:53:08.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.744224] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69424f129613f6e7a377518a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69424f129613f6e7a377518a: start","job_status":"start","queue_duration_s":0.573246,"scheduling_latency_s":0.573262} gitlab # [ 268.756407] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69424f129613f6e7a377518a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69424f129613f6e7a377518a: done: 0.015541 sec","job_status":"done","queue_duration_s":0.573246,"scheduling_latency_s":0.573262,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015541,"completed_at":"2026-08-20T08:53:08.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.796672] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51fc97078ca9083e777eaa4","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51fc97078ca9083e777eaa4: start","job_status":"start","queue_duration_s":0.589934,"scheduling_latency_s":0.589951} gitlab # [ 268.809120] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51fc97078ca9083e777eaa4","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51fc97078ca9083e777eaa4: done: 0.015694 sec","job_status":"done","queue_duration_s":0.589934,"scheduling_latency_s":0.589951,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015694,"completed_at":"2026-08-20T08:53:08.540Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.848556] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59a5cba88e3ebdb1c5c43c41","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59a5cba88e3ebdb1c5c43c41: start","job_status":"start","queue_duration_s":0.606692,"scheduling_latency_s":0.606708} gitlab # [ 268.860916] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59a5cba88e3ebdb1c5c43c41","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59a5cba88e3ebdb1c5c43c41: done: 0.016103 sec","job_status":"done","queue_duration_s":0.606692,"scheduling_latency_s":0.606708,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016103,"completed_at":"2026-08-20T08:53:08.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.900370] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e77c64fc44cf7718a2210d1","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e77c64fc44cf7718a2210d1: start","job_status":"start","queue_duration_s":0.623958,"scheduling_latency_s":0.623975} gitlab # [ 268.912725] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e77c64fc44cf7718a2210d1","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e77c64fc44cf7718a2210d1: done: 0.015334 sec","job_status":"done","queue_duration_s":0.623958,"scheduling_latency_s":0.623975,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015334,"completed_at":"2026-08-20T08:53:08.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.951911] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29e9f24c59de4a37e4864cc5","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29e9f24c59de4a37e4864cc5: start","job_status":"start","queue_duration_s":0.640369,"scheduling_latency_s":0.640385} gitlab # [ 268.964613] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29e9f24c59de4a37e4864cc5","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29e9f24c59de4a37e4864cc5: done: 0.01493 sec","job_status":"done","queue_duration_s":0.640369,"scheduling_latency_s":0.640385,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01493,"completed_at":"2026-08-20T08:53:08.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.005498] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e787505f19309b59b13536e","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e787505f19309b59b13536e: start","job_status":"start","queue_duration_s":0.656425,"scheduling_latency_s":0.656441} gitlab # [ 269.018046] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e787505f19309b59b13536e","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e787505f19309b59b13536e: done: 0.015097 sec","job_status":"done","queue_duration_s":0.656425,"scheduling_latency_s":0.656441,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015097,"completed_at":"2026-08-20T08:53:08.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.057090] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f79c23de9cf3ef0e90da1d4","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f79c23de9cf3ef0e90da1d4: start","job_status":"start","queue_duration_s":0.673584,"scheduling_latency_s":0.673602} gitlab # [ 269.069456] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f79c23de9cf3ef0e90da1d4","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f79c23de9cf3ef0e90da1d4: done: 0.014816 sec","job_status":"done","queue_duration_s":0.673584,"scheduling_latency_s":0.673602,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014816,"completed_at":"2026-08-20T08:53:08.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.108451] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65c5b8a4d298bad10f1a0bc3","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65c5b8a4d298bad10f1a0bc3: start","job_status":"start","queue_duration_s":0.689472,"scheduling_latency_s":0.689489} gitlab # [ 269.120776] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65c5b8a4d298bad10f1a0bc3","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65c5b8a4d298bad10f1a0bc3: done: 0.015189 sec","job_status":"done","queue_duration_s":0.689472,"scheduling_latency_s":0.689489,"redis_calls":13,"redis_duration_s":0.0023510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015189,"completed_at":"2026-08-20T08:53:08.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.159686] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f875a73e5122526ef5645186","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f875a73e5122526ef5645186: start","job_status":"start","queue_duration_s":0.705733,"scheduling_latency_s":0.70575} gitlab # [ 269.172194] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f875a73e5122526ef5645186","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f875a73e5122526ef5645186: done: 0.014867 sec","job_status":"done","queue_duration_s":0.705733,"scheduling_latency_s":0.70575,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014867,"completed_at":"2026-08-20T08:53:08.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.211936] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92d27aa08b33fed51c877aba","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92d27aa08b33fed51c877aba: start","job_status":"start","queue_duration_s":0.721723,"scheduling_latency_s":0.72174} gitlab # [ 269.224573] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92d27aa08b33fed51c877aba","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92d27aa08b33fed51c877aba: done: 0.015626 sec","job_status":"done","queue_duration_s":0.721723,"scheduling_latency_s":0.72174,"redis_calls":13,"redis_duration_s":0.0020540000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-08-20T08:53:08.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.263436] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"017cce6bac16c85be990d935","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-017cce6bac16c85be990d935: start","job_status":"start","queue_duration_s":0.739273,"scheduling_latency_s":0.73929} gitlab # [ 269.275945] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"017cce6bac16c85be990d935","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-017cce6bac16c85be990d935: done: 0.017589 sec","job_status":"done","queue_duration_s":0.739273,"scheduling_latency_s":0.73929,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017589,"completed_at":"2026-08-20T08:53:08.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.315244] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3104a12a53f02e36abfc5be","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3104a12a53f02e36abfc5be: start","job_status":"start","queue_duration_s":0.757934,"scheduling_latency_s":0.75795} gitlab # [ 269.328239] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3104a12a53f02e36abfc5be","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3104a12a53f02e36abfc5be: done: 0.015207 sec","job_status":"done","queue_duration_s":0.757934,"scheduling_latency_s":0.75795,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-08-20T08:53:08.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.367761] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aefa8126a3c970c9fa1a84cf","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aefa8126a3c970c9fa1a84cf: start","job_status":"start","queue_duration_s":0.774239,"scheduling_latency_s":0.774256} gitlab # [ 269.380252] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aefa8126a3c970c9fa1a84cf","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aefa8126a3c970c9fa1a84cf: done: 0.015452 sec","job_status":"done","queue_duration_s":0.774239,"scheduling_latency_s":0.774256,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015452,"completed_at":"2026-08-20T08:53:08.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.420635] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77bc44c670b069517941029a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77bc44c670b069517941029a: start","job_status":"start","queue_duration_s":0.792112,"scheduling_latency_s":0.79213} gitlab # [ 269.432800] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77bc44c670b069517941029a","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77bc44c670b069517941029a: done: 0.016121 sec","job_status":"done","queue_duration_s":0.792112,"scheduling_latency_s":0.79213,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016121,"completed_at":"2026-08-20T08:53:08.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.472462] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ed9413831f4c89737fbaf3","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ed9413831f4c89737fbaf3: start","job_status":"start","queue_duration_s":0.809302,"scheduling_latency_s":0.809317} gitlab # [ 269.485423] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ed9413831f4c89737fbaf3","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ed9413831f4c89737fbaf3: done: 0.016207 sec","job_status":"done","queue_duration_s":0.809302,"scheduling_latency_s":0.809317,"redis_calls":13,"redis_duration_s":0.003031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00245,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016207,"completed_at":"2026-08-20T08:53:08.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.524723] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af369d0ae7513055d5d2d5c9","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af369d0ae7513055d5d2d5c9: start","job_status":"start","queue_duration_s":0.826625,"scheduling_latency_s":0.826642} gitlab # [ 269.537059] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af369d0ae7513055d5d2d5c9","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af369d0ae7513055d5d2d5c9: done: 0.015337 sec","job_status":"done","queue_duration_s":0.826625,"scheduling_latency_s":0.826642,"redis_calls":13,"redis_duration_s":0.002574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-08-20T08:53:08.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.576050] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"525651e0534e5a84f3e21b93","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-525651e0534e5a84f3e21b93: start","job_status":"start","queue_duration_s":0.843061,"scheduling_latency_s":0.843079} gitlab # [ 269.588433] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"525651e0534e5a84f3e21b93","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-525651e0534e5a84f3e21b93: done: 0.016154 sec","job_status":"done","queue_duration_s":0.843061,"scheduling_latency_s":0.843079,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016154,"completed_at":"2026-08-20T08:53:08.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.628466] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b04babfc10511a72fc6935d9","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b04babfc10511a72fc6935d9: start","job_status":"start","queue_duration_s":0.861406,"scheduling_latency_s":0.861424} gitlab # [ 269.640926] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b04babfc10511a72fc6935d9","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b04babfc10511a72fc6935d9: done: 0.015285 sec","job_status":"done","queue_duration_s":0.861406,"scheduling_latency_s":0.861424,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015285,"completed_at":"2026-08-20T08:53:08.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.680240] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a67df02c037fcd31716da7a3","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a67df02c037fcd31716da7a3: start","job_status":"start","queue_duration_s":0.877841,"scheduling_latency_s":0.87786} gitlab # [ 269.692625] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a67df02c037fcd31716da7a3","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a67df02c037fcd31716da7a3: done: 0.015887 sec","job_status":"done","queue_duration_s":0.877841,"scheduling_latency_s":0.87786,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015887,"completed_at":"2026-08-20T08:53:08.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.731758] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e1da8787f19eaa4e51c4403","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e1da8787f19eaa4e51c4403: start","job_status":"start","queue_duration_s":0.894987,"scheduling_latency_s":0.895008} gitlab # [ 269.744438] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e1da8787f19eaa4e51c4403","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e1da8787f19eaa4e51c4403: done: 0.016359 sec","job_status":"done","queue_duration_s":0.894987,"scheduling_latency_s":0.895008,"redis_calls":13,"redis_duration_s":0.001729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016359,"completed_at":"2026-08-20T08:53:08.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.783443] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad39c8b8846fcaac17a9e201","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad39c8b8846fcaac17a9e201: start","job_status":"start","queue_duration_s":0.912606,"scheduling_latency_s":0.912629} gitlab # [ 269.796109] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad39c8b8846fcaac17a9e201","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad39c8b8846fcaac17a9e201: done: 0.016651 sec","job_status":"done","queue_duration_s":0.912606,"scheduling_latency_s":0.912629,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016651,"completed_at":"2026-08-20T08:53:08.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.836402] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69114c8a50d5aa159f048fa5","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69114c8a50d5aa159f048fa5: start","job_status":"start","queue_duration_s":0.930304,"scheduling_latency_s":0.930321} gitlab # [ 269.848492] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69114c8a50d5aa159f048fa5","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69114c8a50d5aa159f048fa5: done: 0.015015 sec","job_status":"done","queue_duration_s":0.930304,"scheduling_latency_s":0.930321,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015015,"completed_at":"2026-08-20T08:53:08.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.887720] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6852a14f944586c81c7061e5","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6852a14f944586c81c7061e5: start","job_status":"start","queue_duration_s":0.946368,"scheduling_latency_s":0.946384} gitlab # [ 269.900323] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6852a14f944586c81c7061e5","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6852a14f944586c81c7061e5: done: 0.016056 sec","job_status":"done","queue_duration_s":0.946368,"scheduling_latency_s":0.946384,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016056,"completed_at":"2026-08-20T08:53:08.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.940094] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dca44d40053969d18936a91e","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dca44d40053969d18936a91e: start","job_status":"start","queue_duration_s":0.963816,"scheduling_latency_s":0.963832} gitlab # [ 269.952198] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dca44d40053969d18936a91e","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dca44d40053969d18936a91e: done: 0.017274 sec","job_status":"done","queue_duration_s":0.963816,"scheduling_latency_s":0.963832,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017274,"completed_at":"2026-08-20T08:53:08.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.991773] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e56ae6cf92e8e1a5fc63c72f","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e56ae6cf92e8e1a5fc63c72f: start","job_status":"start","queue_duration_s":0.982517,"scheduling_latency_s":0.982533} gitlab # [ 270.004406] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e56ae6cf92e8e1a5fc63c72f","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e56ae6cf92e8e1a5fc63c72f: done: 0.016294 sec","job_status":"done","queue_duration_s":0.982517,"scheduling_latency_s":0.982533,"redis_calls":13,"redis_duration_s":0.003056,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016294,"completed_at":"2026-08-20T08:53:08.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.044582] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53c6770641e219b58d551759","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53c6770641e219b58d551759: start","job_status":"start","queue_duration_s":1.000237,"scheduling_latency_s":1.000253} gitlab # [ 270.056760] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53c6770641e219b58d551759","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53c6770641e219b58d551759: done: 0.016388 sec","job_status":"done","queue_duration_s":1.000237,"scheduling_latency_s":1.000253,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016388,"completed_at":"2026-08-20T08:53:08.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.096424] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3e3e4fafad800e0cbb972eb","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3e3e4fafad800e0cbb972eb: start","job_status":"start","queue_duration_s":1.017999,"scheduling_latency_s":1.018016} gitlab # [ 270.108637] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3e3e4fafad800e0cbb972eb","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3e3e4fafad800e0cbb972eb: done: 0.015688 sec","job_status":"done","queue_duration_s":1.017999,"scheduling_latency_s":1.018016,"redis_calls":13,"redis_duration_s":0.002669,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015688,"completed_at":"2026-08-20T08:53:08.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.147761] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da3d0a4d1aff03fa08db7a12","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da3d0a4d1aff03fa08db7a12: start","job_status":"start","queue_duration_s":1.036137,"scheduling_latency_s":1.036154} gitlab # [ 270.160235] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da3d0a4d1aff03fa08db7a12","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da3d0a4d1aff03fa08db7a12: done: 0.0159 sec","job_status":"done","queue_duration_s":1.036137,"scheduling_latency_s":1.036154,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0159,"completed_at":"2026-08-20T08:53:08.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.199359] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:08.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c2465b858a952405be6f87b","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c2465b858a952405be6f87b: start","job_status":"start","queue_duration_s":1.053357,"scheduling_latency_s":1.053373} gitlab # [ 270.211727] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c2465b858a952405be6f87b","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c2465b858a952405be6f87b: done: 0.016843 sec","job_status":"done","queue_duration_s":1.053357,"scheduling_latency_s":1.053373,"redis_calls":13,"redis_duration_s":0.002695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016843,"completed_at":"2026-08-20T08:53:09.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.252669] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bc4497d04ed942297b56f79","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bc4497d04ed942297b56f79: start","job_status":"start","queue_duration_s":1.071606,"scheduling_latency_s":1.071622} gitlab # [ 270.264954] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bc4497d04ed942297b56f79","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bc4497d04ed942297b56f79: done: 0.014651 sec","job_status":"done","queue_duration_s":1.071606,"scheduling_latency_s":1.071622,"redis_calls":13,"redis_duration_s":0.002627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014651,"completed_at":"2026-08-20T08:53:09.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.304496] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168f2a306e4aa25f3b050c57","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168f2a306e4aa25f3b050c57: start","job_status":"start","queue_duration_s":1.087565,"scheduling_latency_s":1.087581} gitlab # [ 270.316710] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168f2a306e4aa25f3b050c57","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168f2a306e4aa25f3b050c57: done: 0.016356 sec","job_status":"done","queue_duration_s":1.087565,"scheduling_latency_s":1.087581,"redis_calls":13,"redis_duration_s":0.002597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016356,"completed_at":"2026-08-20T08:53:09.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.355991] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46f0cefafc80223dee841ab8","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46f0cefafc80223dee841ab8: start","job_status":"start","queue_duration_s":1.105362,"scheduling_latency_s":1.105377} gitlab # [ 270.368539] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46f0cefafc80223dee841ab8","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46f0cefafc80223dee841ab8: done: 0.015977 sec","job_status":"done","queue_duration_s":1.105362,"scheduling_latency_s":1.105377,"redis_calls":13,"redis_duration_s":0.003138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015977,"completed_at":"2026-08-20T08:53:09.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.407467] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33bce4a3067531779c7082d8","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33bce4a3067531779c7082d8: start","job_status":"start","queue_duration_s":1.12261,"scheduling_latency_s":1.122625} gitlab # [ 270.420178] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33bce4a3067531779c7082d8","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33bce4a3067531779c7082d8: done: 0.015077 sec","job_status":"done","queue_duration_s":1.12261,"scheduling_latency_s":1.122625,"redis_calls":13,"redis_duration_s":0.002695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001771,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015077,"completed_at":"2026-08-20T08:53:09.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.460191] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ecde1c054990b58f2023ebe","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ecde1c054990b58f2023ebe: start","job_status":"start","queue_duration_s":1.138983,"scheduling_latency_s":1.139} gitlab # [ 270.472962] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ecde1c054990b58f2023ebe","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ecde1c054990b58f2023ebe: done: 0.015095 sec","job_status":"done","queue_duration_s":1.138983,"scheduling_latency_s":1.139,"redis_calls":13,"redis_duration_s":0.002646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015095,"completed_at":"2026-08-20T08:53:09.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.512728] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b2c262c77e17095f45cb6f","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b2c262c77e17095f45cb6f: start","job_status":"start","queue_duration_s":1.156,"scheduling_latency_s":1.156016} gitlab # [ 270.525166] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b2c262c77e17095f45cb6f","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b2c262c77e17095f45cb6f: done: 0.01544 sec","job_status":"done","queue_duration_s":1.156,"scheduling_latency_s":1.156016,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01544,"completed_at":"2026-08-20T08:53:09.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.564444] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5a1e9995ccb8a74519c5bed","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5a1e9995ccb8a74519c5bed: start","job_status":"start","queue_duration_s":1.172796,"scheduling_latency_s":1.172812} gitlab # [ 270.576696] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5a1e9995ccb8a74519c5bed","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5a1e9995ccb8a74519c5bed: done: 0.015171 sec","job_status":"done","queue_duration_s":1.172796,"scheduling_latency_s":1.172812,"redis_calls":13,"redis_duration_s":0.002616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015171,"completed_at":"2026-08-20T08:53:09.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.616075] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f4e3d9b8a0613ba92eef12b","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f4e3d9b8a0613ba92eef12b: start","job_status":"start","queue_duration_s":1.18929,"scheduling_latency_s":1.189305} gitlab # [ 270.629469] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:53:09.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f4e3d9b8a0613ba92eef12b","created_at":"2026-08-20T08:53:07.860Z","trace_propagation_headers":{"sentry-trace":"1f0eacb17e8b410c8173084696a07791-2780b77444534ce0","baggage":"sentry-trace_id=1f0eacb17e8b410c8173084696a07791,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1f948bfe3cc70625840d59678499fb71","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:53:07.935Z","job_size_bytes":2,"pid":2004,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f4e3d9b8a0613ba92eef12b: done: 0.015114 sec","job_status":"done","queue_duration_s":1.18929,"scheduling_latency_s":1.189305,"redis_calls":13,"redis_duration_s":0.002775,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-08-20T08:53:09.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 272.611532] setup-gitlab-start[2965]: W, [2026-08-20T08:53:13.380758 #2965] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 309.243695] redis[791]: 10 changes in 300 seconds. Saving... gitlab # [ 309.251222] redis[791]: Background saving started by pid 3300 gitlab # [ 309.268095] redis[3300]: BGSAVE done, 464 keys saved, 0 keys skipped, 119735 bytes written. gitlab # [ 309.276910] redis[3300]: DB saved on disk gitlab # [ 309.280758] redis[3300]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.346009] redis[791]: Background saving terminated with success gitlab # [ 310.324522] postgres[856]: [856] LOG: checkpoint starting: time gitlab # [ 311.781305] gitaly[892]: time="2026-08-20T08:53:52.549Z" level=info msg="burden monitor stats" pid=892 gitlab # [ 314.647350] postgres[3301]: [3301] ERROR: relation "table_without_models" does not exist gitlab # [ 314.647748] postgres[3301]: [3301] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 320.470564] runuser[2964]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 320.472722] setup-gitlab-start[2943]: + systemctl restart gitlab-sidekiq.service gitlab # [ 320.525967] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:01.295Z","message":"Shutting down"} gitlab # [ 320.528235] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:01.295Z","message":"Scheduler exiting..."} gitlab # [ 320.530365] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:01.297Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 320.533282] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 320.536369] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:01.299Z","message":"Scheduler exiting..."} gitlab # [ 321.030633] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:01.800Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 324.035266] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:04.803Z","message":"Bye!"} gitlab # [ 324.077123] sidekiq-cluster[2004]: {"severity":"INFO","time":"2026-08-20T08:54:04.846Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2004,"worker_id":"sidekiq_0","memwd_rss_bytes":963305472,"retry":0} gitlab # [ 325.192310] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 325.192696] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 325.192941] systemd[1]: gitlab-sidekiq.service: Consumed 1min 51.846s CPU time over 3min 23.369s wall clock time, 948.7M memory peak, 4.5M read from disk. gitlab # [ 325.206579] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 325.210747] setup-gitlab-start[2943]: + mkdir -p /var/lib/secrets gitlab # [ 325.218398] setup-gitlab-start[2943]: + echo nixbot-test-token-of-20-chars gitlab # [ 325.221549] setup-gitlab-start[2943]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 325.224844] setup-gitlab-start[2943]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 326.487469] gitaly[892]: time="2026-08-20T08:54:07.256Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.255" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.488039] gitaly[892]: time="2026-08-20T08:54:07.257Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.255" grpc.time_ms=1.462 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.774395] gitaly[892]: time="2026-08-20T08:54:07.544Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.293" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.543" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.798162] gitaly[892]: time="2026-08-20T08:54:07.544Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.293" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.543" grpc.time_ms=0.595 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.858748] gitaly[892]: time="2026-08-20T08:54:07.628Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 diskcache=52b33558-c78e-4e9f-8c49-2d6022d549b8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:54:17.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.560" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.885275] gitaly[892]: time="2026-08-20T08:54:07.629Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=36 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=6 command.system_time_ms=29 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:54:17.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.560" grpc.time_ms=68.562 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.909298] gitaly[892]: time="2026-08-20T08:54:07.653Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.102" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.652" pid=892 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 326.924265] gitaly[892]: time="2026-08-20T08:54:07.654Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.102" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.652" grpc.time_ms=1.514 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.939220] gitaly[892]: time="2026-08-20T08:54:07.680Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:54:17.111" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.662" grpc.time_ms=16.891 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.015979] gitaly[892]: time="2026-08-20T08:54:07.785Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.234" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.785" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.047822] gitaly[892]: time="2026-08-20T08:54:07.786Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.234" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.785" grpc.time_ms=0.664 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.083768] gitaly[892]: time="2026-08-20T08:54:07.832Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 diskcache=e62e37dc-1a75-4f7f-ad29-4e0f52127bd7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:54:17.242" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.793" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.113128] gitaly[892]: time="2026-08-20T08:54:07.833Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=20 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:54:17.242" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.793" grpc.time_ms=40.065 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.142660] gitaly[892]: time="2026-08-20T08:54:07.841Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.289" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.840" pid=892 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 327.162094] gitaly[892]: time="2026-08-20T08:54:07.841Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.289" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.840" grpc.time_ms=1.303 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.182719] gitaly[892]: time="2026-08-20T08:54:07.855Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:54:17.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.846" grpc.time_ms=9.018 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.212853] gitaly[892]: time="2026-08-20T08:54:07.894Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:54:17.053" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.894" grpc.time_ms=0.142 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.235195] gitaly[892]: time="2026-08-20T08:54:07.903Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:54:17.061" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:07.902" grpc.time_ms=0.883 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.919720] gitaly[892]: time="2026-08-20T08:54:08.688Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F619Y69MV3KXBVV0D2BFF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:54:18.119" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:08.670" grpc.time_ms=17.774 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 330.104802] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:10 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 4850 gitlab # [ 330.109291] setup-gitlab-start[2943]: + mkdir -p /tmp/test-flake gitlab # [ 330.110610] setup-gitlab-start[2943]: + cd /tmp/test-flake gitlab # [ 330.115862] setup-gitlab-start[2943]: + git init -b master gitlab # [ 330.124955] setup-gitlab-start[3429]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 330.128570] setup-gitlab-start[2943]: + git config user.name test gitlab # [ 330.131119] setup-gitlab-start[2943]: + git config user.email test@example.com gitlab # [ 330.134149] setup-gitlab-start[2943]: + cat gitlab # [ 330.135955] setup-gitlab-start[2943]: + git add flake.nix gitlab # [ 330.138287] setup-gitlab-start[2943]: + git commit -m 'initial commit' gitlab # [ 330.150709] setup-gitlab-start[3434]: [master (root-commit) 4468f33] initial commit gitlab # [ 330.154231] setup-gitlab-start[3434]: 1 file changed, 10 insertions(+) gitlab # [ 330.157148] setup-gitlab-start[3434]: create mode 100644 flake.nix gitlab # [ 330.159756] setup-gitlab-start[2943]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 330.164631] setup-gitlab-start[2943]: + git push -u origin master gitlab # [ 330.259584] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 60 gitlab # [ 330.427862] gitaly[892]: time="2026-08-20T08:54:11.196Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61ETQSDF0XV7Y74AFFHQG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:11.182" grpc.time_ms=14.161 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 330.443947] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 166 gitlab # [ 330.497742] sidekiq-cluster[3372]: {"severity":"INFO","time":"2026-08-20T08:54:11.226Z","message":"Starting cluster with 1 processes"} gitlab # [ 331.585228] gitaly[892]: time="2026-08-20T08:54:12.354Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:54:22.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:12.336" grpc.time_ms=17.424 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 331.681765] gitaly[892]: time="2026-08-20T08:54:12.451Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:54:42.030" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:54:12.431" grpc.time_ms=19.84 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 331.750839] gitaly[892]: time="2026-08-20T08:54:12.520Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F61F0K8M1JY4V6P1JTM503 duration_ms=395ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 331.820300] gitaly[892]: time="2026-08-20T08:54:12.590Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F61F0K8M1JY4V6P1JTM503 duration_ms=67ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 331.834493] gitaly[892]: time="2026-08-20T08:54:12.591Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:12.122" grpc.time_ms=468.068 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 331.884169] gitaly[892]: time="2026-08-20T08:54:12.653Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:12.651" grpc.time_ms=1.859 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 331.942211] gitaly[892]: time="2026-08-20T08:54:12.712Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:12.710" grpc.time_ms=1.167 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.025247] gitaly[892]: time="2026-08-20T08:54:12.795Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:12.794" grpc.time_ms=0.863 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.207715] gitaly[892]: time="2026-08-20T08:54:12.977Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:54:22.118" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:12.959" grpc.time_ms=17.746 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.257160] gitaly[892]: time="2026-08-20T08:54:13.027Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=5 command.system_time_ms=25 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:54:22.148" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:12.990" grpc.time_ms=36.306 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 332.299285] gitaly[892]: time="2026-08-20T08:54:13.069Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F61F0K8M1JY4V6P1JTM503 duration_ms=221ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 332.305581] gitaly[892]: time="2026-08-20T08:54:13.071Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:12.847" grpc.time_ms=224.168 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.327622] gitaly[892]: time="2026-08-20T08:54:13.085Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 diskcache=052e93f7-cee0-4e70-91e0-06e1281fcf0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:12.003" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.345807] setup-gitlab-start[3438]: To http://gitlab/root/test-flake.git gitlab # [ 332.347272] setup-gitlab-start[3438]: * [new branch] master -> master gitlab # [ 332.348801] setup-gitlab-start[3438]: branch 'master' set up to track 'origin/master'. gitlab # [ 332.350855] gitlab-workhorse[814]: time="2026-08-20T08:54:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 332.353779] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:13 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1866 gitlab # [ 332.356935] systemd[1]: Finished setup-gitlab.service. gitlab # [ 332.358013] gitaly[892]: time="2026-08-20T08:54:13.085Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=368 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13314 command.oublock=32 command.real_time_ms=1073 command.spawn_token_fork_ms=0 command.system_time_ms=182 command.user_time_ms=186 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:12.003" grpc.time_ms=1082.207 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 332.377767] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 333.13 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 333.710250] nixbot[3534]: {"ts": "2026-08-20T08:54:14.479Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 333.751861] nixbot[3534]: {"ts": "2026-08-20T08:54:14.521Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 333.779779] nixbot[3534]: {"ts": "2026-08-20T08:54:14.549Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 333.786875] nixbot[3534]: {"ts": "2026-08-20T08:54:14.555Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 333.794025] nixbot[3534]: {"ts": "2026-08-20T08:54:14.560Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 333.800712] nixbot[3534]: {"ts": "2026-08-20T08:54:14.568Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 333.807556] nixbot[3534]: {"ts": "2026-08-20T08:54:14.573Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 333.814201] nixbot[3534]: {"ts": "2026-08-20T08:54:14.575Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 333.820866] nixbot[3534]: {"ts": "2026-08-20T08:54:14.582Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 333.827434] nixbot[3534]: {"ts": "2026-08-20T08:54:14.585Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 333.834341] nixbot[3534]: {"ts": "2026-08-20T08:54:14.590Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 333.840933] nixbot[3534]: {"ts": "2026-08-20T08:54:14.598Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 333.847405] nixbot[3534]: {"ts": "2026-08-20T08:54:14.602Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 333.853714] nixbot[3534]: {"ts": "2026-08-20T08:54:14.604Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 333.859985] nixbot[3534]: {"ts": "2026-08-20T08:54:14.608Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 333.865734] nixbot[3534]: {"ts": "2026-08-20T08:54:14.611Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 333.871298] nixbot[3534]: {"ts": "2026-08-20T08:54:14.614Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 333.876829] nixbot[3534]: {"ts": "2026-08-20T08:54:14.616Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 333.881471] nixbot[3534]: {"ts": "2026-08-20T08:54:14.621Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 333.886093] nixbot[3534]: {"ts": "2026-08-20T08:54:14.624Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 333.890322] nixbot[3534]: {"ts": "2026-08-20T08:54:14.626Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 333.894116] nixbot[3534]: {"ts": "2026-08-20T08:54:14.631Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 333.899797] nixbot[3534]: {"ts": "2026-08-20T08:54:14.633Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 333.907698] nixbot[3534]: {"ts": "2026-08-20T08:54:14.636Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 333.915166] nixbot[3534]: {"ts": "2026-08-20T08:54:14.637Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 334.375273] nixbot[3534]: INFO: Started server process [3534] gitlab # [ 334.378764] nixbot[3534]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 334.396879] nixbot[3534]: INFO: ::ffff:127.0.0.1:58554 - "GET /health HTTP/1.1" 200 OK gitlab # [ 334.409344] systemd[1]: Started nixbot CI service. gitlab # [ 334.412066] systemd[1]: Reached target Multi-User System. gitlab # [ 334.416525] systemd[1]: Startup finished in 867ms (kernel) + 4.137s (initrd) + 5min 29.410s (userspace) = 5min 34.416s. gitlab: (finished: waiting for unit nixbot.service, in 2.13 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 334.867950] nixbot[3534]: INFO: ::ffff:127.0.0.1:58570 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 334.906740] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:15 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 509 gitlab # [ 334.916236] nixbot[3534]: {"ts": "2026-08-20T08:54:15.683Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 334.960119] nixbot[3534]: {"ts": "2026-08-20T08:54:15.729Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 335.041217] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 111 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds) gitlab # [ 335.150221] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 170 gitlab # [ 335.156835] nixbot[3534]: {"ts": "2026-08-20T08:54:15.921Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 335.163761] nixbot[3534]: {"ts": "2026-08-20T08:54:15.922Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 335.395233] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 239 gitlab # [ 335.402090] nixbot[3534]: {"ts": "2026-08-20T08:54:16.166Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 336.276682] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 172 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds) (finished: subtest: project discovered and webhook registered, in 1.41 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 336.356181] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 943 gitlab # [ 336.368651] nixbot[3534]: {"ts": "2026-08-20T08:54:17.123Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 336.393027] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 42 gitlab # [ 336.454615] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 68 gitlab # [ 336.456827] nixbot[3534]: {"ts": "2026-08-20T08:54:17.225Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 336.512489] gitaly[892]: time="2026-08-20T08:54:17.279Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MTK1KH8Z3WMJ0H0WHW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.267" grpc.time_ms=11.177 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Enumerating objects: 5, done. gitlab # [ 336.526195] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 108 gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 336.555316] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 95 gitlab # [ 336.557911] nixbot[3534]: {"ts": "2026-08-20T08:54:17.326Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 336.677802] gitaly[892]: time="2026-08-20T08:54:17.447Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MZREDK340VA99428MGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T08:54:47.030" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:17.431" grpc.time_ms=15.304 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.702406] gitaly[892]: time="2026-08-20T08:54:17.472Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MZREDK340VA99428MGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:54:47.064" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:17.465" grpc.time_ms=6.726 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.731953] gitaly[892]: time="2026-08-20T08:54:17.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=17 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MZREDK340VA99428MGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T08:54:27.146" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:17.476" grpc.time_ms=24.869 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.775299] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 208 gitlab # [ 336.778971] nixbot[3534]: {"ts": "2026-08-20T08:54:17.546Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 336.849336] gitaly[892]: time="2026-08-20T08:54:17.619Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:54:47.001" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:54:17.601" grpc.time_ms=17.169 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.882424] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 86 gitlab # [ 336.887945] nixbot[3534]: {"ts": "2026-08-20T08:54:17.638Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 336.894950] nixbot[3534]: {"ts": "2026-08-20T08:54:17.654Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 336.918376] gitaly[892]: time="2026-08-20T08:54:17.687Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ duration_ms=206ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 336.956088] gitaly[892]: time="2026-08-20T08:54:17.726Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ duration_ms=37ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 336.968297] gitaly[892]: time="2026-08-20T08:54:17.726Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:17.479" grpc.time_ms=246.417 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 337.010751] gitaly[892]: time="2026-08-20T08:54:17.780Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61NAX1JR4DKGZV1F3E7AV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.772" grpc.time_ms=8.371 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.025072] gitaly[892]: time="2026-08-20T08:54:17.795Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:17.792" grpc.time_ms=1.932 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 337.037023] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 88 gitlab # [ 337.083620] gitaly[892]: time="2026-08-20T08:54:17.853Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:17.850" grpc.time_ms=2.758 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 337.138361] gitaly[892]: time="2026-08-20T08:54:17.908Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:17.907" grpc.time_ms=0.638 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 337.161695] gitaly[892]: time="2026-08-20T08:54:17.908Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NE14GB49A4335HWAF8V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.889" pid=892 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 337.178976] gitlab-workhorse[814]: time="2026-08-20T08:54:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 337.182011] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 116 gitlab # [ 337.185029] gitaly[892]: time="2026-08-20T08:54:17.909Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NE14GB49A4335HWAF8V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.889" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.206184] gitaly[892]: time="2026-08-20T08:54:17.909Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NE14GB49A4335HWAF8V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.889" grpc.time_ms=19.598 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.236296] gitaly[892]: time="2026-08-20T08:54:18.006Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NHS41MJ9ND36FXWX70H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.976" pid=892 remote_ip="2001:db8:1::1" request_sha=d2410d4c8280cf857f43430da98bf168261dd19f response_bytes=424 span.kind=server system=grpc gitlab # [ 337.251878] gitaly[892]: time="2026-08-20T08:54:18.006Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NHS41MJ9ND36FXWX70H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.976" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.272732] gitlab-workhorse[814]: time="2026-08-20T08:54:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=424 gitlab # To http://gitlab/root/test-flake.git gitlab # [ 337.275210] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 424 "" "git/2.55.0" 93 gitlab # 4468f33..44a1efa [ 337.278988] gitlab-workhorse[814]: time="2026-08-20T08:54:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 337.281512] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 731 gitlab # gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.02 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 337.288111] gitaly[892]: time="2026-08-20T08:54:18.007Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NHS41MJ9ND36FXWX70H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.976" grpc.time_ms=30.633 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.308357] gitaly[892]: time="2026-08-20T08:54:18.027Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ duration_ms=51ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 337.311561] gitaly[892]: time="2026-08-20T08:54:18.027Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:17.974" grpc.time_ms=52.603 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 337.322980] gitaly[892]: time="2026-08-20T08:54:18.039Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ diskcache=0d9dbf0b-d4e8-461d-ab17-2e6696c895b1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.384" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 337.334360] gitaly[892]: time="2026-08-20T08:54:18.049Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=252 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13168 command.oublock=32 command.real_time_ms=648 command.spawn_token_fork_ms=0 command.system_time_ms=117 command.user_time_ms=135 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:17.384" grpc.time_ms=654.995 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 337.348194] gitaly[892]: time="2026-08-20T08:54:18.115Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61NP395TFFCMX7V5WZBWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.107" grpc.time_ms=8.051 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.361320] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 64 gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.12 seconds) gitlab # [ 337.435487] nixbot[3534]: INFO: ::ffff:127.0.0.1:58580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 337.441933] gitaly[892]: time="2026-08-20T08:54:18.212Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NR5PM1NHZPBXNCE7E7B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.201" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 337.466115] gitaly[892]: time="2026-08-20T08:54:18.212Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NR5PM1NHZPBXNCE7E7B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.201" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.493393] gitlab-workhorse[814]: time="2026-08-20T08:54:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 337.496570] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 94 gitlab # [ 337.499732] gitaly[892]: time="2026-08-20T08:54:18.212Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NR5PM1NHZPBXNCE7E7B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.201" grpc.time_ms=10.324 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.554646] gitaly[892]: time="2026-08-20T08:54:18.323Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F61NW58D24M0X23DZCT69A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.311" grpc.time_ms=12.117 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.578254] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 78 gitlab # [ 337.647166] gitaly[892]: time="2026-08-20T08:54:18.417Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NYPGD6ZRGCA7S5WH9NN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.382" pid=892 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 337.676186] gitaly[892]: time="2026-08-20T08:54:18.417Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=29 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NYPGD6ZRGCA7S5WH9NN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.382" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.704869] gitlab-workhorse[814]: time="2026-08-20T08:54:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 337.708401] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 91 gitlab # [ 337.711963] gitaly[892]: time="2026-08-20T08:54:18.417Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=29 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61NYPGD6ZRGCA7S5WH9NN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:18.382" grpc.time_ms=35.396 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.931412] gitaly[892]: time="2026-08-20T08:54:18.701Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:54:48.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:18.700" grpc.time_ms=1.196 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 337.980253] gitaly[892]: time="2026-08-20T08:54:18.750Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:54:48.139" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:18.739" grpc.time_ms=10.223 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.065031] gitaly[892]: time="2026-08-20T08:54:18.835Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:54:28.266" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:18.816" grpc.time_ms=17.803 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.135274] gitaly[892]: time="2026-08-20T08:54:18.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:54:28.046" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:18.886" grpc.time_ms=17.945 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.283701] gitaly[892]: time="2026-08-20T08:54:19.053Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:54:29.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:19.052" grpc.time_ms=0.68 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.317326] gitaly[892]: time="2026-08-20T08:54:19.084Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=568 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:54:29.017" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:19.068" grpc.time_ms=15.439 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.390132] gitaly[892]: time="2026-08-20T08:54:19.160Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:19.155" grpc.time_ms=4.243 pid=892 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 338.436447] gitaly[892]: time="2026-08-20T08:54:19.206Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:54:19.205" grpc.time_ms=0.918 pid=892 span.kind=server system=grpc gitlab # [ 338.467955] gitaly[892]: time="2026-08-20T08:54:19.219Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV diskcache=fff1bf9b-c7f1-4b47-8361-6a303d99a28b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:54:29.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:19.090" pid=892 ref=refs/keep-around/4468f33eddb68890507078d5935f91519e8497a3 remote_ip="2001:db8:1::1" revision=4468f33eddb68890507078d5935f91519e8497a3 span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 338.497834] gitaly[892]: time="2026-08-20T08:54:19.219Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5481 command.oublock=8 command.real_time_ms=120 command.spawn_token_fork_ms=2 command.system_time_ms=61 command.user_time_ms=68 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:54:29.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:54:19.090" grpc.time_ms=129.127 pid=892 ref=refs/keep-around/4468f33eddb68890507078d5935f91519e8497a3 remote_ip="2001:db8:1::1" revision=4468f33eddb68890507078d5935f91519e8497a3 span.kind=server system=grpc username=root gitlab # [ 338.528784] nixbot[3534]: INFO: ::ffff:127.0.0.1:58594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 338.532381] gitaly[892]: time="2026-08-20T08:54:19.231Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:54:49.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:19.226" grpc.time_ms=4.25 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.716905] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 1018 gitlab # [ 338.719962] nixbot[3534]: {"ts": "2026-08-20T08:54:19.488Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab # [ 338.734370] nixbot[3534]: {"ts": "2026-08-20T08:54:19.504Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4468f33eddb6-0"} gitlab # [ 338.840105] systemd[1]: Started Nix Daemon. gitlab # [ 338.953289] nix-daemon[3746]: accepted connection from pid 3740, user nixbot gitlab # [ 339.088443] nix-daemon[3746]: accepted connection from pid 3753, user nixbot gitlab # [ 339.113091] nixbot[3534]: {"ts": "2026-08-20T08:54:19.883Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4468f33eddb6-0", "argv0": "bwrap"} gitlab # [ 339.344338] nix-daemon[3746]: accepted connection from pid 3763, user nixbot gitlab # [ 339.457000] nix-daemon[3746]: accepted connection from pid 3773, user nixbot gitlab # [ 339.479014] nix-daemon[3746]: accepted connection from pid 3763, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 339.554347] nixbot[3534]: INFO: ::ffff:127.0.0.1:58596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 340.607268] nixbot[3534]: INFO: ::ffff:127.0.0.1:58602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 341.662745] nixbot[3534]: INFO: ::ffff:127.0.0.1:45886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 342.717056] nixbot[3534]: INFO: ::ffff:127.0.0.1:45902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 343.769860] gitaly[892]: time="2026-08-20T08:54:24.538Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61VWT6K4S6258BK3CPBE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:54:54.135" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:24.536" grpc.time_ms=1.273 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.09 seconds) gitlab # [ 343.771093] nixbot[3534]: INFO: ::ffff:127.0.0.1:45910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 344.059627] gitaly[892]: time="2026-08-20T08:54:24.829Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61VWT6K4S6258BK3CPBE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:54:34.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:24.811" grpc.time_ms=17.673 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.266998] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 624 gitlab # [ 344.275182] nixbot[3534]: {"ts": "2026-08-20T08:54:25.038Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab # [ 344.360790] gitaly[892]: time="2026-08-20T08:54:25.130Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61WGYC46ERND2HTRR508Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:54:55.028" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:25.129" grpc.time_ms=1.25 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.459656] gitaly[892]: time="2026-08-20T08:54:25.229Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F61WGYC46ERND2HTRR508Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:54:35.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:25.211" grpc.time_ms=17.39 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.575177] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 290 gitlab # [ 344.583531] nixbot[3534]: {"ts": "2026-08-20T08:54:25.347Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab # [ 344.702386] gitaly[892]: time="2026-08-20T08:54:25.472Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61WTSZB09K01GDMHYZMBB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:54:55.270" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:54:25.470" grpc.time_ms=1.16 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 344.795554] gitaly[892]: time="2026-08-20T08:54:25.564Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61WTSZB09K01GDMHYZMBB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:54:35.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:54:25.545" grpc.time_ms=18.84 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.876611] nixbot[3534]: INFO: ::ffff:127.0.0.1:45922 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.07 seconds) gitlab # [ 344.911160] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 310 gitlab # [ 344.919366] nixbot[3534]: {"ts": "2026-08-20T08:54:25.682Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab # [ 345.075203] nix-daemon[3746]: accepted connection from pid 3816, user nixbot gitlab # [ 345.280871] gitaly[892]: time="2026-08-20T08:54:26.050Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61XCDB940Z4NY6QVGNBE6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:26.032" grpc.time_ms=18.105 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 345.324108] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 119 gitlab # [ 345.414777] gitaly[892]: time="2026-08-20T08:54:26.184Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61XG7NQMX6GYY06A6W7CA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:26.164" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 345.439801] gitaly[892]: time="2026-08-20T08:54:26.185Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61XG7NQMX6GYY06A6W7CA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:26.164" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 345.465950] gitlab-workhorse[814]: time="2026-08-20T08:54:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 345.469277] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:54:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 131 gitlab # [ 345.472499] gitaly[892]: time="2026-08-20T08:54:26.187Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61XG7NQMX6GYY06A6W7CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:54:26.164" grpc.time_ms=21.1 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 345.582748] nix-daemon[3746]: accepted connection from pid 3841, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 345.939793] nixbot[3534]: INFO: ::ffff:127.0.0.1:45928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 346.992653] nixbot[3534]: INFO: ::ffff:127.0.0.1:45934 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 348.046713] nixbot[3534]: INFO: ::ffff:127.0.0.1:45946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 349.101749] nixbot[3534]: INFO: ::ffff:127.0.0.1:45952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 350.157683] nixbot[3534]: INFO: ::ffff:127.0.0.1:45954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 351.211681] nixbot[3534]: INFO: ::ffff:127.0.0.1:57450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 352.264778] nixbot[3534]: INFO: ::ffff:127.0.0.1:57464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 353.319198] nixbot[3534]: INFO: ::ffff:127.0.0.1:57466 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 354.376143] nixbot[3534]: INFO: ::ffff:127.0.0.1:57476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 355.432829] nixbot[3534]: INFO: ::ffff:127.0.0.1:57478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 356.481775] nixbot[3534]: INFO: ::ffff:127.0.0.1:57486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 357.537673] nixbot[3534]: INFO: ::ffff:127.0.0.1:57498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 358.593750] nixbot[3534]: INFO: ::ffff:127.0.0.1:57500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 359.648735] nixbot[3534]: INFO: ::ffff:127.0.0.1:57504 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 360.702774] nixbot[3534]: INFO: ::ffff:127.0.0.1:57518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 361.759038] nixbot[3534]: INFO: ::ffff:127.0.0.1:50256 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 362.815222] nixbot[3534]: INFO: ::ffff:127.0.0.1:50260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 363.872336] nixbot[3534]: INFO: ::ffff:127.0.0.1:50266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 364.928267] nixbot[3534]: INFO: ::ffff:127.0.0.1:50278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 365.984702] nixbot[3534]: INFO: ::ffff:127.0.0.1:50292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 367.038704] nixbot[3534]: INFO: ::ffff:127.0.0.1:50296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 368.092736] nixbot[3534]: INFO: ::ffff:127.0.0.1:50302 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 369.145162] nixbot[3534]: INFO: ::ffff:127.0.0.1:50316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 370.199539] nixbot[3534]: INFO: ::ffff:127.0.0.1:50320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 371.254757] nixbot[3534]: INFO: ::ffff:127.0.0.1:57756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 372.288949] nixbot[3534]: INFO: ::ffff:127.0.0.1:57760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 373.344741] nixbot[3534]: INFO: ::ffff:127.0.0.1:57768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 374.277829] sidekiq-cluster[3456]: 2026-08-20T08:54:55.046Z pid=3456 tid=ylk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3456, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427061248} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 374.400958] nixbot[3534]: INFO: ::ffff:127.0.0.1:57774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 374.576864] sidekiq-cluster[3456]: W, [2026-08-20T08:54:55.346864 #3456] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 374.722400] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:54:55.492Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 375.456455] nixbot[3534]: INFO: ::ffff:127.0.0.1:57778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 376.511757] nixbot[3534]: INFO: ::ffff:127.0.0.1:57784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 377.567390] nixbot[3534]: INFO: ::ffff:127.0.0.1:57800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 377.798897] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:54:58.567Z","message":"GitLab reliable fetch activated!"} gitlab # [ 377.804047] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:54:58.568Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 378.620682] nixbot[3534]: INFO: ::ffff:127.0.0.1:57812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 379.678569] nixbot[3534]: INFO: ::ffff:127.0.0.1:57820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 380.730834] nixbot[3534]: INFO: ::ffff:127.0.0.1:57824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 381.782992] nixbot[3534]: INFO: ::ffff:127.0.0.1:45102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 382.838802] nixbot[3534]: INFO: ::ffff:127.0.0.1:45110 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 383.896067] nixbot[3534]: INFO: ::ffff:127.0.0.1:45122 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 384.952184] nixbot[3534]: INFO: ::ffff:127.0.0.1:45130 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 386.006087] nixbot[3534]: INFO: ::ffff:127.0.0.1:45142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 387.061851] nixbot[3534]: INFO: ::ffff:127.0.0.1:45146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 388.117475] nixbot[3534]: INFO: ::ffff:127.0.0.1:45156 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 389.172147] nixbot[3534]: INFO: ::ffff:127.0.0.1:45172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 390.224874] nixbot[3534]: INFO: ::ffff:127.0.0.1:45184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 391.279689] nixbot[3534]: INFO: ::ffff:127.0.0.1:35398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 392.333055] nixbot[3534]: INFO: ::ffff:127.0.0.1:35412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 393.385377] nixbot[3534]: INFO: ::ffff:127.0.0.1:35418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 394.438645] nixbot[3534]: INFO: ::ffff:127.0.0.1:35424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 395.495095] nixbot[3534]: INFO: ::ffff:127.0.0.1:35432 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 396.552721] nixbot[3534]: INFO: ::ffff:127.0.0.1:35440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 397.606050] nixbot[3534]: INFO: ::ffff:127.0.0.1:35442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 398.662627] nixbot[3534]: INFO: ::ffff:127.0.0.1:35450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 399.715706] nixbot[3534]: INFO: ::ffff:127.0.0.1:35462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 400.772239] nixbot[3534]: INFO: ::ffff:127.0.0.1:35464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 401.828844] nixbot[3534]: INFO: ::ffff:127.0.0.1:43588 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 402.883645] nixbot[3534]: INFO: ::ffff:127.0.0.1:43596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 403.936891] nixbot[3534]: INFO: ::ffff:127.0.0.1:43604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 404.993988] nixbot[3534]: INFO: ::ffff:127.0.0.1:43608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 406.049948] nixbot[3534]: INFO: ::ffff:127.0.0.1:43620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 407.103376] nixbot[3534]: INFO: ::ffff:127.0.0.1:43636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 408.160084] nixbot[3534]: INFO: ::ffff:127.0.0.1:43650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 409.215092] nixbot[3534]: INFO: ::ffff:127.0.0.1:43656 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.03 seconds) gitlab # [ 410.252317] nixbot[3534]: INFO: ::ffff:127.0.0.1:43664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 411.303913] nixbot[3534]: INFO: ::ffff:127.0.0.1:57642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 412.358622] nixbot[3534]: INFO: ::ffff:127.0.0.1:57650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 413.415871] nixbot[3534]: INFO: ::ffff:127.0.0.1:57654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 414.471855] nixbot[3534]: INFO: ::ffff:127.0.0.1:57658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 415.171248] postgres[4062]: [4062] ERROR: relation "table_without_models" does not exist gitlab # [ 415.171600] postgres[4062]: [4062] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 415.526871] nixbot[3534]: INFO: ::ffff:127.0.0.1:57664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 416.583123] nixbot[3534]: INFO: ::ffff:127.0.0.1:57674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 417.636994] nixbot[3534]: INFO: ::ffff:127.0.0.1:57686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 418.694450] nixbot[3534]: INFO: ::ffff:127.0.0.1:57692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 419.747699] nixbot[3534]: INFO: ::ffff:127.0.0.1:57702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 420.099153] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:40.868Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 420.104540] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:40.874Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 420.106537] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:40.875Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 420.108323] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:40.876Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 420.110263] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:40.879Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 420.803839] nixbot[3534]: INFO: ::ffff:127.0.0.1:57718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 421.858594] nixbot[3534]: INFO: ::ffff:127.0.0.1:54164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 422.795257] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:43.563Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7d0b58ddb0d42647012927f9","created_at":"2026-08-20T08:54:07.696Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:07.753Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7d0b58ddb0d42647012927f9: start","job_status":"start","queue_duration_s":95.810226,"scheduling_latency_s":95.810331} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 422.911954] nixbot[3534]: INFO: ::ffff:127.0.0.1:54170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.05 seconds) gitlab # [ 423.086772] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:43.855Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7d0b58ddb0d42647012927f9","created_at":"2026-08-20T08:54:07.696Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:07.753Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7d0b58ddb0d42647012927f9: done: 0.292767 sec","job_status":"done","queue_duration_s":95.810226,"scheduling_latency_s":95.810331,"redis_calls":23,"redis_duration_s":0.008416,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004207,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002403,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001806,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1641676,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.292767,"completed_at":"2026-08-20T08:55:43.855Z","load_balancing_strategy":"primary","db_duration_s":0.111563,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.192495] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:43.858Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"d3106b8c214077a04d94145e","created_at":"2026-08-20T08:54:07.771Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:07.779Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-d3106b8c214077a04d94145e: start","job_status":"start","queue_duration_s":96.079683,"scheduling_latency_s":96.079724} gitlab # [ 423.281503] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.050Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"d3106b8c214077a04d94145e","created_at":"2026-08-20T08:54:07.771Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:07.779Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-d3106b8c214077a04d94145e: done: 0.192006 sec","job_status":"done","queue_duration_s":96.079683,"scheduling_latency_s":96.079724,"redis_calls":14,"redis_duration_s":0.004946,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000963,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002391,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15041524,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.192006,"completed_at":"2026-08-20T08:55:44.050Z","load_balancing_strategy":"primary","db_duration_s":0.038891,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.379202] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.053Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"4d9f4b8f966c37661ffe739c","created_at":"2026-08-20T08:54:08.497Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:08.504Z","job_size_bytes":5,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-4d9f4b8f966c37661ffe739c: start","job_status":"start","queue_duration_s":95.548547,"scheduling_latency_s":95.548578} gitlab # [ 423.524543] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.293Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"4d9f4b8f966c37661ffe739c","created_at":"2026-08-20T08:54:08.497Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:08.504Z","job_size_bytes":5,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-4d9f4b8f966c37661ffe739c: done: 0.239842 sec","job_status":"done","queue_duration_s":95.548547,"scheduling_latency_s":95.548578,"redis_calls":12,"redis_duration_s":0.0036220000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000893,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003863,"duration_s":0.239842,"completed_at":"2026-08-20T08:55:44.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043736,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.629664] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.298Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"39c8d73af349e8df6386b5fc","created_at":"2026-08-20T08:54:08.538Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:08.544Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-39c8d73af349e8df6386b5fc: start","job_status":"start","queue_duration_s":95.753754,"scheduling_latency_s":95.753801} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 423.973471] nixbot[3534]: INFO: ::ffff:127.0.0.1:54176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 423.996738] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.764Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"39c8d73af349e8df6386b5fc","created_at":"2026-08-20T08:54:08.538Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:08.544Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-39c8d73af349e8df6386b5fc: done: 0.466713 sec","job_status":"done","queue_duration_s":95.753754,"scheduling_latency_s":95.753801,"redis_calls":11,"redis_duration_s":0.007621,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001184,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.377,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.377,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.34047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009467,"duration_s":0.466713,"completed_at":"2026-08-20T08:55:44.764Z","load_balancing_strategy":"primary","db_duration_s":0.13047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.087610] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.768Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3d22664acd7d9a8e8bebb9bf","created_at":"2026-08-20T08:54:08.547Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:08.553Z","job_size_bytes":89,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3d22664acd7d9a8e8bebb9bf: start","job_status":"start","queue_duration_s":96.214876,"scheduling_latency_s":96.214911} gitlab # [ 424.107967] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.831Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3d22664acd7d9a8e8bebb9bf","created_at":"2026-08-20T08:54:08.547Z","trace_propagation_headers":{"sentry-trace":"8009c4adc7504fedbe1b3629d23f9aa7-993c7a8e7a9b4512","baggage":"sentry-trace_id=8009c4adc7504fedbe1b3629d23f9aa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F619Y69MV3KXBVV0D2BFF4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:08.553Z","job_size_bytes":89,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3d22664acd7d9a8e8bebb9bf: done: 0.063842 sec","job_status":"done","queue_duration_s":96.214876,"scheduling_latency_s":96.214911,"redis_calls":11,"redis_duration_s":0.003741,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001013,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063742,"duration_s":0.063842,"completed_at":"2026-08-20T08:55:44.831Z","load_balancing_strategy":"primary","db_duration_s":0.009111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.154373] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.834Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4468f33eddb68890507078d5935f91519e8497a3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5a28b3c34c07c372d26fb960","created_at":"2026-08-20T08:54:12.927Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-afd95c5778374edb","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:54:12.937Z","job_size_bytes":185,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5a28b3c34c07c372d26fb960: start","job_status":"start","queue_duration_s":91.896553,"scheduling_latency_s":91.896578} gitlab # [ 424.172616] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:44.857Z","message":"changes: \"0000000000000000000000000000000000000000 4468f33eddb68890507078d5935f91519e8497a3 refs/heads/master\\n\""} gitlab # [ 424.175318] gitaly[892]: time="2026-08-20T08:55:44.906Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:55:54.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:44.894" grpc.time_ms=10.513 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.188922] gitaly[892]: time="2026-08-20T08:55:44.931Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:55:54.024" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:44.915" grpc.time_ms=15.928 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.271427] gitaly[892]: time="2026-08-20T08:55:45.041Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:55:55.000" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:45.021" grpc.time_ms=20.018 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.351423] gitaly[892]: time="2026-08-20T08:55:45.121Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:45.120" grpc.time_ms=0.891 pid=892 span.kind=server system=grpc gitlab # [ 424.408383] gitaly[892]: time="2026-08-20T08:55:45.178Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:45.177" grpc.time_ms=0.709 pid=892 span.kind=server system=grpc gitlab # [ 424.437566] gitaly[892]: time="2026-08-20T08:55:45.190Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 diskcache=801f9477-4c93-421e-933e-9b22048e49b1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:55:55.044" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:45.064" pid=892 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 424.460190] gitaly[892]: time="2026-08-20T08:55:45.191Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5107 command.oublock=8 command.real_time_ms=119 command.spawn_token_fork_ms=1 command.system_time_ms=87 command.user_time_ms=49 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:55:55.044" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:45.064" grpc.time_ms=126.563 pid=892 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 424.481770] gitaly[892]: time="2026-08-20T08:55:45.219Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:55:55.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:45.218" grpc.time_ms=0.348 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.496099] gitaly[892]: time="2026-08-20T08:55:45.251Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:55:55.205" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:45.226" grpc.time_ms=25.065 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.663545] gitaly[892]: time="2026-08-20T08:55:45.433Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T08:56:15.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:45.420" grpc.time_ms=12.257 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.722043] gitaly[892]: time="2026-08-20T08:55:45.492Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:55:55.000" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:45.491" grpc.time_ms=0.546 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.752971] gitaly[892]: time="2026-08-20T08:55:45.507Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:55:55.005" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:55:45.496" grpc.time_ms=11.533 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.781698] gitaly[892]: time="2026-08-20T08:55:45.551Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:55:55.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:45.533" grpc.time_ms=17.634 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.810006] gitaly[892]: time="2026-08-20T08:55:45.580Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:55:55.071" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:45.561" grpc.time_ms=18.093 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.863327] gitaly[892]: time="2026-08-20T08:55:45.633Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:56:15.204" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:45.604" grpc.time_ms=28.308 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 425.041894] nixbot[3534]: INFO: ::ffff:127.0.0.1:54178 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.07 seconds) gitlab # [ 425.573184] gitaly[892]: time="2026-08-20T08:55:46.342Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:55:56.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:46.339" grpc.time_ms=2.462 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.624886] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:46.393Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4468f33eddb68890507078d5935f91519e8497a3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5a28b3c34c07c372d26fb960","created_at":"2026-08-20T08:54:12.927Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-afd95c5778374edb","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:54:12.937Z","job_size_bytes":185,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5a28b3c34c07c372d26fb960: done: 1.558854 sec","job_status":"done","queue_duration_s":91.896553,"scheduling_latency_s":91.896578,"gitaly_calls":13,"gitaly_duration_s":0.348045,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.067606,"redis_read_bytes":2103,"redis_write_bytes":21752,"redis_cache_calls":15,"redis_cache_duration_s":0.006389,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009653,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002446,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7840,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.007102,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.026036,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01598,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.336,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.384,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.059486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000826,"exclusive_lock_hold_duration_s":0.03558204,"duration_s":1.558854,"completed_at":"2026-08-20T08:55:46.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.16327,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 425.723471] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:46.395Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4468f33eddb68890507078d5935f91519e8497a3 44a1efac2b8d495c798a775011ad0b5e92463652 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"24670281c9c126cb6810bfd2","created_at":"2026-08-20T08:54:18.004Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-82ea7aecb0bc47c8","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:54:18.006Z","job_size_bytes":185,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-24670281c9c126cb6810bfd2: start","job_status":"start","queue_duration_s":88.389581,"scheduling_latency_s":88.389609} gitlab # [ 425.746477] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:46.412Z","message":"changes: \"4468f33eddb68890507078d5935f91519e8497a3 44a1efac2b8d495c798a775011ad0b5e92463652 refs/heads/master\\n\""} gitlab # [ 425.749609] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:46.480Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a07092d4d95e76c75e6e66a6","created_at":"2026-08-20T08:55:46.475Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"9bc8adcdb0e8f0505ff0bb05","job_size_bytes":46,"pid":3456,"job_status":"deduplicated","message":"ProjectCacheWorker JID-a07092d4d95e76c75e6e66a6: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 425.767020] gitaly[892]: time="2026-08-20T08:55:46.451Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:55:56.106" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:46.436" grpc.time_ms=14.544 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.781174] gitaly[892]: time="2026-08-20T08:55:46.471Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:55:56.129" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:46.460" grpc.time_ms=10.697 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.794631] gitaly[892]: time="2026-08-20T08:55:46.519Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:55:56.015" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:46.506" grpc.time_ms=13.313 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.808066] gitaly[892]: time="2026-08-20T08:55:46.543Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T08:56:16.127" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:46.528" grpc.time_ms=15.382 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.823453] gitaly[892]: time="2026-08-20T08:55:46.575Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:55:56.074" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:55:46.564" grpc.time_ms=10.408 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.842839] gitaly[892]: time="2026-08-20T08:55:46.612Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:55:56.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:46.595" grpc.time_ms=17.495 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 426.015976] gitaly[892]: time="2026-08-20T08:55:46.785Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:55:56.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:46.783" grpc.time_ms=1.845 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 426.064165] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:46.832Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4468f33eddb68890507078d5935f91519e8497a3 44a1efac2b8d495c798a775011ad0b5e92463652 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"24670281c9c126cb6810bfd2","created_at":"2026-08-20T08:54:18.004Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-82ea7aecb0bc47c8","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:54:18.006Z","job_size_bytes":185,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-24670281c9c126cb6810bfd2: done: 0.436369 sec","job_status":"done","queue_duration_s":88.389581,"scheduling_latency_s":88.389609,"gitaly_calls":7,"gitaly_duration_s":0.112617,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.035282,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.003786,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001466,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005011,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012004,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013015,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.048,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.048,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.278344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00095994,"exclusive_lock_hold_duration_s":0.0273247,"duration_s":0.436369,"completed_at":"2026-08-20T08:55:46.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044494,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 426.140373] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:46.837Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2b87b46074a96feefe4cc163","created_at":"2026-08-20T08:54:19.238Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-ee625a58bf5f43dd","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:19.254Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2b87b46074a96feefe4cc163: start","job_status":"start","queue_duration_s":87.582573,"scheduling_latency_s":87.582631} gitlab # [ 426.160448] nixbot[3534]: INFO: ::ffff:127.0.0.1:54184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 426.262810] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:47.031Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2b87b46074a96feefe4cc163","created_at":"2026-08-20T08:54:19.238Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-ee625a58bf5f43dd","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:19.254Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2b87b46074a96feefe4cc163: done: 0.194597 sec","job_status":"done","queue_duration_s":87.582573,"scheduling_latency_s":87.582631,"redis_calls":16,"redis_duration_s":0.0076419999999999995,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003744,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00103044,"duration_s":0.194597,"completed_at":"2026-08-20T08:55:47.031Z","load_balancing_strategy":"primary","db_duration_s":0.037855,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 426.355960] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:47.036Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"dbff66b7b6d7aa929a49efea","created_at":"2026-08-20T08:54:19.257Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-ee625a58bf5f43dd","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:19.272Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-dbff66b7b6d7aa929a49efea: start","job_status":"start","queue_duration_s":87.763912,"scheduling_latency_s":87.763958} gitlab # [ 426.603027] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:47.372Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"dbff66b7b6d7aa929a49efea","created_at":"2026-08-20T08:54:19.257Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-ee625a58bf5f43dd","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:19.272Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-dbff66b7b6d7aa929a49efea: done: 0.336617 sec","job_status":"done","queue_duration_s":87.763912,"scheduling_latency_s":87.763958,"redis_calls":21,"redis_duration_s":0.007801000000000001,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003648,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.267404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054736,"duration_s":0.336617,"completed_at":"2026-08-20T08:55:47.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.720469] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:47.374Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c72c4e649f585074ca332abd","created_at":"2026-08-20T08:54:19.452Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-ee625a58bf5f43dd","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:19.460Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c72c4e649f585074ca332abd: start","job_status":"start","queue_duration_s":87.914063,"scheduling_latency_s":87.914087} gitlab # [ 426.851591] gitaly[892]: time="2026-08-20T08:55:47.619Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:47.618" grpc.time_ms=0.859 pid=892 span.kind=server system=grpc gitlab # [ 426.902180] gitaly[892]: time="2026-08-20T08:55:47.672Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:47.671" grpc.time_ms=0.683 pid=892 span.kind=server system=grpc gitlab # [ 426.957355] gitaly[892]: time="2026-08-20T08:55:47.727Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:47.726" grpc.time_ms=0.715 pid=892 span.kind=server system=grpc gitlab # [ 426.984784] gitaly[892]: time="2026-08-20T08:55:47.740Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV diskcache=f7f4afd8-5bec-4d94-89b8-fb234fb06f75 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:56:17.158" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:47.559" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.004343] gitaly[892]: time="2026-08-20T08:55:47.740Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=199 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7380 command.oublock=0 command.real_time_ms=173 command.spawn_token_fork_ms=1 command.system_time_ms=115 command.user_time_ms=84 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:56:17.158" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:47.559" grpc.time_ms=180.861 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.06 seconds) gitlab # [ 427.171265] nixbot[3534]: INFO: ::ffff:127.0.0.1:54192 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 427.215713] gitaly[892]: time="2026-08-20T08:55:47.985Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:56:17.583" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:47.983" grpc.time_ms=1.659 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.305922] gitaly[892]: time="2026-08-20T08:55:48.075Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61P33BS367JCBHZMTR1YV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:18.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.074" grpc.time_ms=1.523 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.348738] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.117Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c72c4e649f585074ca332abd","created_at":"2026-08-20T08:54:19.452Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-ee625a58bf5f43dd","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:54:19.460Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c72c4e649f585074ca332abd: done: 0.743239 sec","job_status":"done","queue_duration_s":87.914063,"scheduling_latency_s":87.914087,"gitaly_calls":3,"gitaly_duration_s":0.197761,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.041848,"redis_read_bytes":457,"redis_write_bytes":27995,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001679,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002474,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.014092,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.00665,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14489,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.010425,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000837,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000899,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003113,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.037,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.052,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.416413,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.65178486,"duration_s":0.743239,"completed_at":"2026-08-20T08:55:48.117Z","load_balancing_strategy":"primary","db_duration_s":0.118956,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 427.445906] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.120Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9bc8adcdb0e8f0505ff0bb05","created_at":"2026-08-20T08:55:44.936Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:44.975Z","job_size_bytes":46,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9bc8adcdb0e8f0505ff0bb05: start","job_status":"start","queue_duration_s":3.145298,"scheduling_latency_s":3.145331} gitlab # [ 427.463920] gitaly[892]: time="2026-08-20T08:55:48.205Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T14:55:48.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:48.194" grpc.time_ms=9.787 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.475021] gitaly[892]: time="2026-08-20T08:55:48.234Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:56:18.217" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.218" grpc.time_ms=15.993 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.525538] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9bc8adcdb0e8f0505ff0bb05","created_at":"2026-08-20T08:55:44.936Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:44.975Z","job_size_bytes":46,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9bc8adcdb0e8f0505ff0bb05: done: 0.173021 sec","job_status":"done","queue_duration_s":3.145298,"scheduling_latency_s":3.145331,"gitaly_calls":2,"gitaly_duration_s":0.033109,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013040000000000001,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.003073,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001261,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00284,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004551,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001001,"duration_s":0.173021,"completed_at":"2026-08-20T08:55:48.293Z","load_balancing_strategy":"primary","db_duration_s":0.01875,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 427.591741] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.297Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"22bcf86dfc98dd95c28f282f","created_at":"2026-08-20T08:55:45.008Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:45.015Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-22bcf86dfc98dd95c28f282f: start","job_status":"start","queue_duration_s":3.281985,"scheduling_latency_s":3.282032} gitlab # [ 427.614298] gitaly[892]: time="2026-08-20T08:55:48.384Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 diskcache=1f451402-88f6-4bff-a108-64e59bbb5bf8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:55:48.345" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.346" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.626586] gitaly[892]: time="2026-08-20T08:55:48.385Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=46 command.spawn_token_fork_ms=4 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:55:48.345" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.346" grpc.time_ms=38.12 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.690259] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.459Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"22bcf86dfc98dd95c28f282f","created_at":"2026-08-20T08:55:45.008Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:45.015Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-22bcf86dfc98dd95c28f282f: done: 0.161815 sec","job_status":"done","queue_duration_s":3.281985,"scheduling_latency_s":3.282032,"gitaly_calls":1,"gitaly_duration_s":0.042488,"redis_calls":15,"redis_duration_s":0.006954,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000671,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001728,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.02,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11167512,"duration_s":0.161815,"completed_at":"2026-08-20T08:55:48.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.762749] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.462Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"1e7f7d323881af49df27e824","created_at":"2026-08-20T08:55:45.210Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:45.214Z","job_size_bytes":23,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1e7f7d323881af49df27e824: start","job_status":"start","queue_duration_s":3.248119,"scheduling_latency_s":3.248151} gitlab # [ 427.779566] gitaly[892]: time="2026-08-20T08:55:48.527Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:56:18.508" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.508" grpc.time_ms=18.459 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.792957] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.542Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"1e7f7d323881af49df27e824","created_at":"2026-08-20T08:55:45.210Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:45.214Z","job_size_bytes":23,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1e7f7d323881af49df27e824: done: 0.080676 sec","job_status":"done","queue_duration_s":3.248119,"scheduling_latency_s":3.248151,"gitaly_calls":1,"gitaly_duration_s":0.021816,"redis_calls":16,"redis_duration_s":0.005304,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000413,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002414,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080676,"completed_at":"2026-08-20T08:55:48.542Z","load_balancing_strategy":"primary","db_duration_s":0.005374,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 427.839538] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:48.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4ebf1a7de5665817afa5c30d","created_at":"2026-08-20T08:55:46.058Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a8922b20070c5f0a33c37c9bff9fea0632121e072610e83575a8e84b7319252f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.067Z","job_size_bytes":467,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4ebf1a7de5665817afa5c30d: start","job_status":"start","queue_duration_s":2.478108,"scheduling_latency_s":2.478134} gitlab # [ 427.892930] gitaly[892]: time="2026-08-20T08:55:48.585Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:18.583" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.584" grpc.time_ms=0.98 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.922277] gitaly[892]: time="2026-08-20T08:55:48.606Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:55:58.098" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:48.588" grpc.time_ms=17.274 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.990802] gitaly[892]: time="2026-08-20T08:55:48.760Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:56:18.758" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.759" grpc.time_ms=1.306 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 428.028692] gitaly[892]: time="2026-08-20T08:55:48.768Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:56:18.764" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:48.764" grpc.time_ms=3.891 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 428.108453] gitaly[892]: time="2026-08-20T08:55:48.878Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:55:58.079" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:48.860" grpc.time_ms=18.128 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.07 seconds) gitlab # [ 428.240848] nixbot[3534]: INFO: ::ffff:127.0.0.1:54202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 428.901187] gitaly[892]: time="2026-08-20T08:55:49.670Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:56:19.640" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:49.641" grpc.time_ms=28.646 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 428.926431] gitaly[892]: time="2026-08-20T08:55:49.696Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61F0K8M1JY4V6P1JTM503 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:56:19.672" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:49.673" grpc.time_ms=22.901 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 428.978506] sidekiq-cluster[3456]: {"severity":"WARN","time":"2026-08-20T08:55:49.732Z","class":"CreatePipelineWorker","correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"4468f33eddb68890507078d5935f91519e8497a3","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4468f33eddb68890507078d5935f91519e8497a3","ref":"refs/heads/master"},"retry":0} gitlab # [ 428.991657] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:49.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4ebf1a7de5665817afa5c30d","created_at":"2026-08-20T08:55:46.058Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a8922b20070c5f0a33c37c9bff9fea0632121e072610e83575a8e84b7319252f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.067Z","job_size_bytes":467,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4ebf1a7de5665817afa5c30d: done: 1.196991 sec","job_status":"done","queue_duration_s":2.478108,"scheduling_latency_s":2.478134,"gitaly_calls":7,"gitaly_duration_s":0.113731,"redis_calls":51,"redis_duration_s":0.013708,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.001095,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005722,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00397,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.997473,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052126,"duration_s":1.196991,"completed_at":"2026-08-20T08:55:49.742Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083387,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 429.052152] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:49.744Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a19901f7-039b-4450-a773-985f715096b9\"}"],"class":"WebHookWorker","jid":"738c94dcff96693e1b6bdcac","created_at":"2026-08-20T08:55:46.290Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cc96b882ef15a48b0f41fd6d70d6c8254eb5be9bb3cb28d584c6d1594b04ddd4","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.298Z","job_size_bytes":1751,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-738c94dcff96693e1b6bdcac: start","job_status":"start","queue_duration_s":3.445583,"scheduling_latency_s":3.445608} gitlab # [ 429.208493] nixbot[3534]: INFO: ::ffff:127.0.0.1:54214 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.09 seconds) gitlab # [ 429.256243] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:50.021Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a19901f7-039b-4450-a773-985f715096b9\"}"],"class":"WebHookWorker","jid":"738c94dcff96693e1b6bdcac","created_at":"2026-08-20T08:55:46.290Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-69b517de8f5a436c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cc96b882ef15a48b0f41fd6d70d6c8254eb5be9bb3cb28d584c6d1594b04ddd4","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.298Z","job_size_bytes":1751,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-738c94dcff96693e1b6bdcac: done: 0.277142 sec","job_status":"done","queue_duration_s":3.445583,"scheduling_latency_s":3.445608,"redis_calls":19,"redis_duration_s":0.00642,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001724,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000808,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002718,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08522805999996308,"cpu_s":0.169329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067024,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.277142,"completed_at":"2026-08-20T08:55:50.021Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 429.376288] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:50.027Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"78d3e170d5836721fc4d3cfb","created_at":"2026-08-20T08:55:46.493Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"22bcf86dfc98dd95c28f282f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.498Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-78d3e170d5836721fc4d3cfb: start","job_status":"start","queue_duration_s":3.528536,"scheduling_latency_s":3.528583} gitlab # [ 429.400136] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:50.130Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"78d3e170d5836721fc4d3cfb","created_at":"2026-08-20T08:55:46.493Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"22bcf86dfc98dd95c28f282f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.498Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-78d3e170d5836721fc4d3cfb: done: 0.103582 sec","job_status":"done","queue_duration_s":3.528536,"scheduling_latency_s":3.528583,"gitaly_calls":1,"gitaly_duration_s":0.018616,"redis_calls":12,"redis_duration_s":0.005224,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000901,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05437374,"duration_s":0.103582,"completed_at":"2026-08-20T08:55:50.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 429.449131] nixbot[3534]: INFO: ::ffff:127.0.0.1:54228 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 429.451103] gitaly[892]: time="2026-08-20T08:55:50.089Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ diskcache=bae5515c-84c2-4a3c-8921-ceb590dbc887 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:55:50.075" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.075" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.461351] gitaly[892]: time="2026-08-20T08:55:50.090Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:55:50.075" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.075" grpc.time_ms=13.956 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.475065] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 116 gitlab # [ 429.477294] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:50.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7bf19897624f59b8bcecc920","created_at":"2026-08-20T08:55:46.722Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4d20dcf8f7c00031387415fff59bf0cbf6fb54eccf49cb0bca29fac798713f47","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.728Z","job_size_bytes":467,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7bf19897624f59b8bcecc920: start","job_status":"start","queue_duration_s":3.406358,"scheduling_latency_s":3.406404} gitlab # [ 429.494485] gitaly[892]: time="2026-08-20T08:55:50.147Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64FGFAZHGS0HPS2WPV1RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:50.136" grpc.time_ms=10.58 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 429.507903] gitlab-workhorse[814]: time="2026-08-20T08:55:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 429.509894] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 104 gitlab # [ 429.511757] gitaly[892]: time="2026-08-20T08:55:50.186Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:20.184" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.185" grpc.time_ms=0.957 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.525794] gitaly[892]: time="2026-08-20T08:55:50.206Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:56:00.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:50.191" grpc.time_ms=14.87 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.538917] gitaly[892]: time="2026-08-20T08:55:50.254Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FM6WV0KNT2BGHKZ55XJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:50.241" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 429.549246] nixbot[3534]: {"ts": "2026-08-20T08:55:50.291Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 429.551673] gitaly[892]: time="2026-08-20T08:55:50.254Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FM6WV0KNT2BGHKZ55XJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:50.241" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 429.565389] gitaly[892]: time="2026-08-20T08:55:50.254Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FM6WV0KNT2BGHKZ55XJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:50.241" grpc.time_ms=13.507 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 429.580068] gitaly[892]: time="2026-08-20T08:55:50.275Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:56:20.274" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.275" grpc.time_ms=0.718 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.592808] gitaly[892]: time="2026-08-20T08:55:50.289Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=37 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:56:20.284" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.284" grpc.time_ms=4.643 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.608831] gitaly[892]: time="2026-08-20T08:55:50.360Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=7 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:00.163" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:50.343" grpc.time_ms=16.199 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.622080] gitaly[892]: time="2026-08-20T08:55:50.374Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:20.171" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.371" grpc.time_ms=0.732 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.673390] gitaly[892]: time="2026-08-20T08:55:50.443Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:00.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:50.433" grpc.time_ms=10.013 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.732957] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 196 gitlab # [ 429.738016] nixbot[3534]: {"ts": "2026-08-20T08:55:50.504Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab # [ 429.805258] gitaly[892]: time="2026-08-20T08:55:50.575Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FZHVXW1QRH0BW6S265Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:20.173" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.574" grpc.time_ms=0.937 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.907488] gitaly[892]: time="2026-08-20T08:55:50.676Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64FZHVXW1QRH0BW6S265Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:00.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:50.658" grpc.time_ms=18.069 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 430.014302] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 270 gitlab # [ 430.022391] nixbot[3534]: {"ts": "2026-08-20T08:55:50.786Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab # [ 430.122305] gitaly[892]: time="2026-08-20T08:55:50.892Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64G8DY9T0F75M8MX9SBJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:20.690" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:50.890" grpc.time_ms=1.255 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 430.202113] gitaly[892]: time="2026-08-20T08:55:50.972Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64G8DY9T0F75M8MX9SBJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:00.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:50.951" grpc.time_ms=19.846 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 430.279544] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 251 gitlab # [ 430.287617] nixbot[3534]: {"ts": "2026-08-20T08:55:51.050Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4468f33eddb68890507078d5935f91519e8497a3 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 430.311293] gitaly[892]: time="2026-08-20T08:55:51.081Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:56:21.064" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:51.064" grpc.time_ms=16.424 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.04 seconds) gitlab # [ 430.354057] gitaly[892]: time="2026-08-20T08:55:51.097Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F61MYXKFWRQW6B6TBHFKXJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:56:21.084" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:51.084" grpc.time_ms=12.904 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 430.384722] sidekiq-cluster[3456]: {"severity":"WARN","time":"2026-08-20T08:55:51.114Z","class":"CreatePipelineWorker","correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"4468f33eddb68890507078d5935f91519e8497a3","after":"44a1efac2b8d495c798a775011ad0b5e92463652","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"44a1efac2b8d495c798a775011ad0b5e92463652","ref":"refs/heads/master"},"retry":0} gitlab # [ 430.398802] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7bf19897624f59b8bcecc920","created_at":"2026-08-20T08:55:46.722Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4d20dcf8f7c00031387415fff59bf0cbf6fb54eccf49cb0bca29fac798713f47","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.728Z","job_size_bytes":467,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7bf19897624f59b8bcecc920: done: 0.98562 sec","job_status":"done","queue_duration_s":3.406358,"scheduling_latency_s":3.406404,"gitaly_calls":7,"gitaly_duration_s":0.093545,"redis_calls":33,"redis_duration_s":0.012754000000000001,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000701,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.008469,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001822,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.857233,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.98562,"completed_at":"2026-08-20T08:55:51.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037628,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 430.469400] nixbot[3534]: INFO: ::ffff:127.0.0.1:54230 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 430.471481] nixbot[3534]: INFO: ::ffff:127.0.0.1:54238 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 430.472885] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 74 gitlab # [ 430.475337] gitlab-workhorse[814]: time="2026-08-20T08:55:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 430.477372] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 63 gitlab # [ 430.479298] gitaly[892]: time="2026-08-20T08:55:51.171Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F64GHT6934VRX4E7WRN5KZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.162" grpc.time_ms=8.496 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.492861] gitaly[892]: time="2026-08-20T08:55:51.237Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GM8747K0MB4GGD61Q9F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.225" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 430.503189] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.122Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f7d188cc-7d98-4fa9-a7c0-495076e5afa6\"}"],"class":"WebHookWorker","jid":"cdb7ebb95ad39a10fd1c742e","created_at":"2026-08-20T08:55:46.756Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7fee89a540ac27b132f06ee8e6e18657358299f1dd88f0730f9f9fd4f2ffc8e5","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.760Z","job_size_bytes":1749,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cdb7ebb95ad39a10fd1c742e: start","job_status":"start","queue_duration_s":4.361891,"scheduling_latency_s":4.361917} gitlab # [ 430.521038] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.198Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f7d188cc-7d98-4fa9-a7c0-495076e5afa6\"}"],"class":"WebHookWorker","jid":"cdb7ebb95ad39a10fd1c742e","created_at":"2026-08-20T08:55:46.756Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-41de8221ef864551","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7fee89a540ac27b132f06ee8e6e18657358299f1dd88f0730f9f9fd4f2ffc8e5","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:46.760Z","job_size_bytes":1749,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cdb7ebb95ad39a10fd1c742e: done: 0.07571 sec","job_status":"done","queue_duration_s":4.361891,"scheduling_latency_s":4.361917,"redis_calls":14,"redis_duration_s":0.011232,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000466,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00824,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002526,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0070326599999930295,"cpu_s":0.049771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.07571,"completed_at":"2026-08-20T08:55:51.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 430.571079] gitaly[892]: time="2026-08-20T08:55:51.237Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GM8747K0MB4GGD61Q9F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.225" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.584816] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7d60e026e70f14e384ee4438","created_at":"2026-08-20T08:55:47.536Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.543Z","job_size_bytes":23,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7d60e026e70f14e384ee4438: start","job_status":"start","queue_duration_s":3.657063,"scheduling_latency_s":3.6571} gitlab # [ 430.601261] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.338Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7d60e026e70f14e384ee4438","created_at":"2026-08-20T08:55:47.536Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.543Z","job_size_bytes":23,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7d60e026e70f14e384ee4438: done: 0.138071 sec","job_status":"done","queue_duration_s":3.657063,"scheduling_latency_s":3.6571,"redis_calls":10,"redis_duration_s":0.00515,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00244382,"duration_s":0.138071,"completed_at":"2026-08-20T08:55:51.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025233,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 430.646535] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 58 gitlab # [ 430.648709] gitaly[892]: time="2026-08-20T08:55:51.238Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GM8747K0MB4GGD61Q9F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.225" grpc.time_ms=12.209 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.663665] nix-daemon[3746]: accepted connection from pid 4314, user nixbot gitlab # [ 430.664750] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.342Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a42fbba0a62e34dfc24102f6","created_at":"2026-08-20T08:55:47.751Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.762Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a42fbba0a62e34dfc24102f6: start","job_status":"start","queue_duration_s":3.580151,"scheduling_latency_s":3.580203} gitlab # [ 430.681398] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.416Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a42fbba0a62e34dfc24102f6","created_at":"2026-08-20T08:55:47.751Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.762Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a42fbba0a62e34dfc24102f6: done: 0.073294 sec","job_status":"done","queue_duration_s":3.580151,"scheduling_latency_s":3.580203,"redis_calls":10,"redis_duration_s":0.007796,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000851,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048626,"duration_s":0.073294,"completed_at":"2026-08-20T08:55:51.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 430.726256] gitlab-workhorse[814]: time="2026-08-20T08:55:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 430.728154] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 70 gitlab # [ 430.730014] gitaly[892]: time="2026-08-20T08:55:51.345Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64GQQ56YTG46B5MC8JQYE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.334" grpc.time_ms=10.511 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.743348] gitaly[892]: time="2026-08-20T08:55:51.417Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GSKAMA0T71X01DK5BY8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.404" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 430.754922] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.418Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e44f64da9612b89bf9f19cd4","created_at":"2026-08-20T08:55:47.789Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.803Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e44f64da9612b89bf9f19cd4: start","job_status":"start","queue_duration_s":3.614321,"scheduling_latency_s":3.614349} gitlab # [ 430.771116] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.477Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e44f64da9612b89bf9f19cd4","created_at":"2026-08-20T08:55:47.789Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.803Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e44f64da9612b89bf9f19cd4: done: 0.05906 sec","job_status":"done","queue_duration_s":3.614321,"scheduling_latency_s":3.614349,"redis_calls":10,"redis_duration_s":0.003634,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000377,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00161,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055672,"duration_s":0.05906,"completed_at":"2026-08-20T08:55:51.476Z","load_balancing_strategy":"primary","db_duration_s":0.007743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 430.815293] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 57 gitlab # [ 430.817500] gitaly[892]: time="2026-08-20T08:55:51.417Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GSKAMA0T71X01DK5BY8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.404" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.831231] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"035fa2d89c000fc176886cb0","created_at":"2026-08-20T08:55:47.833Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.842Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-035fa2d89c000fc176886cb0: start","job_status":"start","queue_duration_s":3.637405,"scheduling_latency_s":3.63743} gitlab # [ 430.848162] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"035fa2d89c000fc176886cb0","created_at":"2026-08-20T08:55:47.833Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.842Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-035fa2d89c000fc176886cb0: done: 0.062248 sec","job_status":"done","queue_duration_s":3.637405,"scheduling_latency_s":3.63743,"redis_calls":13,"redis_duration_s":0.002577,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00058,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037594,"duration_s":0.062248,"completed_at":"2026-08-20T08:55:51.541Z","load_balancing_strategy":"primary","db_duration_s":0.008081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 430.893714] gitlab-workhorse[814]: time="2026-08-20T08:55:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 430.895535] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 80 gitlab # [ 430.897557] gitaly[892]: time="2026-08-20T08:55:51.418Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GSKAMA0T71X01DK5BY8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.404" grpc.time_ms=13.735 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.912222] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.543Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"780426c64fcd63e25b992b75","created_at":"2026-08-20T08:55:47.843Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.853Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-780426c64fcd63e25b992b75: start","job_status":"start","queue_duration_s":3.690026,"scheduling_latency_s":3.690056} gitlab # [ 430.928643] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"780426c64fcd63e25b992b75","created_at":"2026-08-20T08:55:47.843Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.853Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-780426c64fcd63e25b992b75: done: 0.051202 sec","job_status":"done","queue_duration_s":3.690026,"scheduling_latency_s":3.690056,"redis_calls":10,"redis_duration_s":0.002598,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000931,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032828,"duration_s":0.051202,"completed_at":"2026-08-20T08:55:51.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 430.975464] gitaly[892]: time="2026-08-20T08:55:51.515Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64GX256J88JR6V84E1SC0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.504" grpc.time_ms=10.478 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 430.988749] gitaly[892]: time="2026-08-20T08:55:51.597Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GYXE5HBDADX3501WW6X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.566" pid=892 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 430.999109] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e8d396d6ecf6b2c60142f55e","created_at":"2026-08-20T08:55:47.855Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.863Z","job_size_bytes":19,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e8d396d6ecf6b2c60142f55e: start","job_status":"start","queue_duration_s":3.733402,"scheduling_latency_s":3.733423} gitlab # [ 431.015867] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e8d396d6ecf6b2c60142f55e","created_at":"2026-08-20T08:55:47.855Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.863Z","job_size_bytes":19,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e8d396d6ecf6b2c60142f55e: done: 0.045915 sec","job_status":"done","queue_duration_s":3.733402,"scheduling_latency_s":3.733423,"redis_calls":11,"redis_duration_s":0.00193,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030662,"duration_s":0.045915,"completed_at":"2026-08-20T08:55:51.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.061566] gitaly[892]: time="2026-08-20T08:55:51.597Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GYXE5HBDADX3501WW6X grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.566" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 431.075915] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.646Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"07b0f1d7cecac4e067dd1abf","created_at":"2026-08-20T08:55:47.868Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.876Z","job_size_bytes":66,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-07b0f1d7cecac4e067dd1abf: start","job_status":"start","queue_duration_s":3.770011,"scheduling_latency_s":3.770032} gitlab # [ 431.093762] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.698Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"07b0f1d7cecac4e067dd1abf","created_at":"2026-08-20T08:55:47.868Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.876Z","job_size_bytes":66,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-07b0f1d7cecac4e067dd1abf: done: 0.051776 sec","job_status":"done","queue_duration_s":3.770011,"scheduling_latency_s":3.770032,"redis_calls":10,"redis_duration_s":0.006798,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003214,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056146,"duration_s":0.051776,"completed_at":"2026-08-20T08:55:51.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.139937] gitaly[892]: time="2026-08-20T08:55:51.603Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64GYXE5HBDADX3501WW6X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:51.566" grpc.time_ms=31.132 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 431.155201] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"937b6c769d223ece787b6d68","created_at":"2026-08-20T08:55:47.878Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.884Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-937b6c769d223ece787b6d68: start","job_status":"start","queue_duration_s":3.816314,"scheduling_latency_s":3.816337} gitlab # [ 431.173258] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"937b6c769d223ece787b6d68","created_at":"2026-08-20T08:55:47.878Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.884Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-937b6c769d223ece787b6d68: done: 0.053239 sec","job_status":"done","queue_duration_s":3.816314,"scheduling_latency_s":3.816337,"redis_calls":10,"redis_duration_s":0.0020870000000000003,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026618,"duration_s":0.053239,"completed_at":"2026-08-20T08:55:51.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.218304] gitaly[892]: time="2026-08-20T08:55:51.704Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:21.501" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:51.703" grpc.time_ms=0.954 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.231249] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.755Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b95226eddf8f7c0e50881701","created_at":"2026-08-20T08:55:47.893Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.906Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b95226eddf8f7c0e50881701: start","job_status":"start","queue_duration_s":3.848666,"scheduling_latency_s":3.848685} gitlab # [ 431.248118] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.810Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b95226eddf8f7c0e50881701","created_at":"2026-08-20T08:55:47.893Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.906Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b95226eddf8f7c0e50881701: done: 0.054994 sec","job_status":"done","queue_duration_s":3.848666,"scheduling_latency_s":3.848685,"redis_calls":10,"redis_duration_s":0.007905,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002157,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025782,"duration_s":0.054994,"completed_at":"2026-08-20T08:55:51.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.292637] gitaly[892]: time="2026-08-20T08:55:51.734Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:56:21.516" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:51.716" grpc.time_ms=18.072 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.306736] nixbot[3534]: {"ts": "2026-08-20T08:55:52.003Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 \"HTTP/1.1 201 Created\""} gitlab # [ 431.309613] nixbot[3534]: {"ts": "2026-08-20T08:55:52.009Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-44a1efac2b8d-4"} gitlab # [ 431.311887] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"32e735aa1902e6bc4071cd06","created_at":"2026-08-20T08:55:47.908Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.921Z","job_size_bytes":6,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-32e735aa1902e6bc4071cd06: start","job_status":"start","queue_duration_s":3.891254,"scheduling_latency_s":3.891274} gitlab # [ 431.328321] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"32e735aa1902e6bc4071cd06","created_at":"2026-08-20T08:55:47.908Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.921Z","job_size_bytes":6,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-32e735aa1902e6bc4071cd06: done: 0.029747 sec","job_status":"done","queue_duration_s":3.891254,"scheduling_latency_s":3.891274,"redis_calls":10,"redis_duration_s":0.001507,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028714,"duration_s":0.029747,"completed_at":"2026-08-20T08:55:51.841Z","load_balancing_strategy":"primary","db_duration_s":0.005048,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.373589] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 364 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652' gitlab # [ 431.376101] gitaly[892]: time="2026-08-20T08:55:51.759Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:01.201" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:51.741" grpc.time_ms=17.398 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.390135] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.843Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6c5a1d2e9cded7dfd7c3c86a","created_at":"2026-08-20T08:55:47.922Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.932Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6c5a1d2e9cded7dfd7c3c86a: start","job_status":"start","queue_duration_s":3.910545,"scheduling_latency_s":3.910566} gitlab # [ 431.404540] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.889Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6c5a1d2e9cded7dfd7c3c86a","created_at":"2026-08-20T08:55:47.922Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.932Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6c5a1d2e9cded7dfd7c3c86a: done: 0.045973 sec","job_status":"done","queue_duration_s":3.910545,"scheduling_latency_s":3.910566,"redis_calls":10,"redis_duration_s":0.00141,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002616,"duration_s":0.045973,"completed_at":"2026-08-20T08:55:51.889Z","load_balancing_strategy":"primary","db_duration_s":0.013319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.447768] nix-daemon[3746]: accepted connection from pid 4372, user nixbot gitlab # [ 431.448860] gitaly[892]: time="2026-08-20T08:55:51.781Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:56:01.240" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:51.780" grpc.time_ms=0.298 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.460207] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.891Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"f38491638a852d4fb7a9de28","created_at":"2026-08-20T08:55:47.946Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.957Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-f38491638a852d4fb7a9de28: start","job_status":"start","queue_duration_s":3.934068,"scheduling_latency_s":3.934093} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652', in 0.10 seconds) (finished: subtest: push delivers the webhook, in 95.20 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses gitlab # [ 431.476739] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.964Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"f38491638a852d4fb7a9de28","created_at":"2026-08-20T08:55:47.946Z","trace_propagation_headers":{"sentry-trace":"bcc188868a244ab0aaa01a11d028cac2-9e763bbe771c481d","baggage":"sentry-trace_id=bcc188868a244ab0aaa01a11d028cac2,sentry-release=Unknown"},"correlation_id":"01M0F61P33BS367JCBHZMTR1YV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:47.957Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-f38491638a852d4fb7a9de28: done: 0.073015 sec","job_status":"done","queue_duration_s":3.934068,"scheduling_latency_s":3.934093,"redis_calls":14,"redis_duration_s":0.0024129999999999998,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030492,"duration_s":0.073015,"completed_at":"2026-08-20T08:55:51.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.521827] nixbot[3534]: INFO: ::ffff:127.0.0.1:55102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 200 OK gitlab # [ 431.523752] nixbot[3534]: {"ts": "2026-08-20T08:55:52.242Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-44a1efac2b8d-4", "argv0": "bwrap"} gitlab # [ 431.526331] gitaly[892]: time="2026-08-20T08:55:51.793Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:56:01.245" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:51.785" grpc.time_ms=7.532 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.539721] gitaly[892]: time="2026-08-20T08:55:51.848Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:51.848" grpc.time_ms=0.556 pid=892 span.kind=server system=grpc gitlab # [ 431.549754] nix-daemon[3746]: accepted connection from pid 4380, user nixbot gitlab # [ 431.550742] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:51.968Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"52123e505d0a74fae1deb40d","created_at":"2026-08-20T08:55:48.252Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-262f5c98c4bc4f33","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:48.264Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-52123e505d0a74fae1deb40d: start","job_status":"start","queue_duration_s":3.703817,"scheduling_latency_s":3.703837} gitlab # [ 431.568563] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.041Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"52123e505d0a74fae1deb40d","created_at":"2026-08-20T08:55:48.252Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-262f5c98c4bc4f33","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:48.264Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-52123e505d0a74fae1deb40d: done: 0.073537 sec","job_status":"done","queue_duration_s":3.703817,"scheduling_latency_s":3.703837,"redis_calls":19,"redis_duration_s":0.004118,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000976,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000636,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001772,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01568456,"duration_s":0.073537,"completed_at":"2026-08-20T08:55:52.041Z","load_balancing_strategy":"primary","db_duration_s":0.013313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.614870] gitaly[892]: time="2026-08-20T08:55:51.880Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:51.880" grpc.time_ms=0.402 pid=892 span.kind=server system=grpc gitlab # [ 431.624810] gitaly[892]: time="2026-08-20T08:55:51.887Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J diskcache=28b82514-9bdf-4b27-8abc-0a1c11437d95 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:56:01.255" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:51.795" pid=892 ref=refs/keep-around/44a1efac2b8d495c798a775011ad0b5e92463652 remote_ip="2001:db8:1::1" revision=44a1efac2b8d495c798a775011ad0b5e92463652 span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses, in 0.17 seconds) gitlab # [ 431.636355] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.043Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","738c94dcff96693e1b6bdcac"],"class":"WebHooks::LogExecutionWorker","jid":"825389e987a23bb1784e1181","created_at":"2026-08-20T08:55:49.984Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-c033a42b3545439c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4e12c5506cc7f28fd6dd9e9a3fa8cace39e5ad195031c46aa2936f02174a3624","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:50.000Z","job_size_bytes":2593,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-825389e987a23bb1784e1181: start","job_status":"start","queue_duration_s":2.043503,"scheduling_latency_s":2.043528} gitlab # [ 431.652923] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.104Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","738c94dcff96693e1b6bdcac"],"class":"WebHooks::LogExecutionWorker","jid":"825389e987a23bb1784e1181","created_at":"2026-08-20T08:55:49.984Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-c033a42b3545439c","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4e12c5506cc7f28fd6dd9e9a3fa8cace39e5ad195031c46aa2936f02174a3624","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:50.000Z","job_size_bytes":2593,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-825389e987a23bb1784e1181: done: 0.060427 sec","job_status":"done","queue_duration_s":2.043503,"scheduling_latency_s":2.043528,"redis_calls":10,"redis_duration_s":0.0022,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030404,"duration_s":0.060427,"completed_at":"2026-08-20T08:55:52.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.698389] gitaly[892]: time="2026-08-20T08:55:51.888Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5618 command.oublock=8 command.real_time_ms=87 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:56:01.255" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:55:51.795" grpc.time_ms=92.306 pid=892 ref=refs/keep-around/44a1efac2b8d495c798a775011ad0b5e92463652 remote_ip="2001:db8:1::1" revision=44a1efac2b8d495c798a775011ad0b5e92463652 span.kind=server system=grpc username=root gitlab # [ 431.713922] nix-daemon[3746]: accepted connection from pid 4417, user nixbot gitlab # [ 431.714865] nix-daemon[3746]: accepted connection from pid 4435, user nixbot gitlab # [ 431.716102] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 134 gitlab # [ 431.718642] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.105Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b233f2279dd0ad680887cf62","created_at":"2026-08-20T08:55:50.480Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-49b5be48e8e944e4","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:50.485Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b233f2279dd0ad680887cf62: start","job_status":"start","queue_duration_s":1.620101,"scheduling_latency_s":1.620121} gitlab # [ 431.734751] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.475Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b233f2279dd0ad680887cf62","created_at":"2026-08-20T08:55:50.480Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-49b5be48e8e944e4","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:50.485Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3456,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b233f2279dd0ad680887cf62: rescheduled"} gitlab # [ 431.751243] gitaly[892]: time="2026-08-20T08:55:51.893Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:21.692" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:51.892" grpc.time_ms=0.415 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.764361] gitaly[892]: time="2026-08-20T08:55:52.272Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:52.271" grpc.time_ms=0.583 pid=892 span.kind=server system=grpc gitlab # [ 431.775102] nix-daemon[3746]: accepted connection from pid 4417, user nixbot gitlab # [ 431.776089] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.484Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b233f2279dd0ad680887cf62","created_at":"2026-08-20T08:55:50.480Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-49b5be48e8e944e4","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:50.485Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b233f2279dd0ad680887cf62: done: 0.378639 sec","job_status":"done","queue_duration_s":1.620101,"scheduling_latency_s":1.620121,"gitaly_calls":3,"gitaly_duration_s":0.146618,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.027354,"redis_read_bytes":151,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.003379,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00094,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004712,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006878,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000576,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00111,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00638,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174791,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.33606712,"duration_s":0.378639,"completed_at":"2026-08-20T08:55:52.484Z","load_balancing_strategy":"primary","db_duration_s":0.042006,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 431.827828] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.485Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cdb7ebb95ad39a10fd1c742e"],"class":"WebHooks::LogExecutionWorker","jid":"847237782f4515ea227a5eb4","created_at":"2026-08-20T08:55:51.182Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-3fae3d7b8ff04504","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8fb130abd9d30af9508e60744a517e833e298512c29506b0f3722a62a11456f4","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.187Z","job_size_bytes":2592,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-847237782f4515ea227a5eb4: start","job_status":"start","queue_duration_s":1.298611,"scheduling_latency_s":1.298638} gitlab # [ 431.844944] gitaly[892]: time="2026-08-20T08:55:52.316Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:52.314" grpc.time_ms=0.724 pid=892 span.kind=server system=grpc gitlab # [ 431.854577] gitaly[892]: time="2026-08-20T08:55:52.349Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:52.348" grpc.time_ms=0.672 pid=892 span.kind=server system=grpc gitlab # [ 431.864408] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.513Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cdb7ebb95ad39a10fd1c742e"],"class":"WebHooks::LogExecutionWorker","jid":"847237782f4515ea227a5eb4","created_at":"2026-08-20T08:55:51.182Z","trace_propagation_headers":{"sentry-trace":"e2c0bd2664dd43a3af8cf4b6db72ed52-3fae3d7b8ff04504","baggage":"sentry-trace_id=e2c0bd2664dd43a3af8cf4b6db72ed52,sentry-release=Unknown"},"correlation_id":"01M0F61MYXKFWRQW6B6TBHFKXJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8fb130abd9d30af9508e60744a517e833e298512c29506b0f3722a62a11456f4","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.187Z","job_size_bytes":2592,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-847237782f4515ea227a5eb4: done: 0.027604 sec","job_status":"done","queue_duration_s":1.298611,"scheduling_latency_s":1.298638,"redis_calls":7,"redis_duration_s":0.001229,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027604,"completed_at":"2026-08-20T08:55:52.513Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.908509] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.515Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5e52b860eef1b1bde55100b4","created_at":"2026-08-20T08:55:51.895Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-286f86c896bf4038","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.901Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5e52b860eef1b1bde55100b4: start","job_status":"start","queue_duration_s":0.613677,"scheduling_latency_s":0.613701} gitlab # [ 431.925462] gitaly[892]: time="2026-08-20T08:55:52.356Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 diskcache=0f7d499b-f2c4-4a55-a6b4-e2a3fec009ed grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:56:22.221" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:52.222" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.935088] gitaly[892]: time="2026-08-20T08:55:52.356Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=109 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7042 command.oublock=0 command.real_time_ms=128 command.spawn_token_fork_ms=1 command.system_time_ms=37 command.user_time_ms=72 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:56:22.221" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:52.222" grpc.time_ms=134.135 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.948592] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.547Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5e52b860eef1b1bde55100b4","created_at":"2026-08-20T08:55:51.895Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-286f86c896bf4038","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.901Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5e52b860eef1b1bde55100b4: done: 0.032701 sec","job_status":"done","queue_duration_s":0.613677,"scheduling_latency_s":0.613701,"redis_calls":7,"redis_duration_s":0.001219,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032701,"completed_at":"2026-08-20T08:55:52.547Z","load_balancing_strategy":"primary","db_duration_s":0.004097,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 431.993023] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.549Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5486baeea1cb321fdfdb5033","created_at":"2026-08-20T08:55:51.902Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-286f86c896bf4038","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.907Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5486baeea1cb321fdfdb5033: start","job_status":"start","queue_duration_s":0.641776,"scheduling_latency_s":0.641801} gitlab # [ 432.011183] gitaly[892]: time="2026-08-20T08:55:52.368Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64HPNVG4PZD0WD0MD8DZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:22.267" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:52.368" grpc.time_ms=0.575 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.024286] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.647Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5486baeea1cb321fdfdb5033","created_at":"2026-08-20T08:55:51.902Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-286f86c896bf4038","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.907Z","job_size_bytes":65,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5486baeea1cb321fdfdb5033: done: 0.098458 sec","job_status":"done","queue_duration_s":0.641776,"scheduling_latency_s":0.641801,"redis_calls":10,"redis_duration_s":0.003371,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.098458,"completed_at":"2026-08-20T08:55:52.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.068346] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"53c9517e332c2a49fbb73e02","created_at":"2026-08-20T08:55:51.985Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-286f86c896bf4038","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.987Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-53c9517e332c2a49fbb73e02: start","job_status":"start","queue_duration_s":0.661367,"scheduling_latency_s":0.661391} gitlab # [ 432.084437] gitaly[892]: time="2026-08-20T08:55:52.432Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:56:22.431" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:52.431" grpc.time_ms=1.099 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.097179] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.798Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"53c9517e332c2a49fbb73e02","created_at":"2026-08-20T08:55:51.985Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-286f86c896bf4038","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:51.987Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-53c9517e332c2a49fbb73e02: done: 0.149489 sec","job_status":"done","queue_duration_s":0.661367,"scheduling_latency_s":0.661391,"gitaly_calls":2,"gitaly_duration_s":0.008208,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008656,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001362,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001205,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000346,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002145,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000362,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000649,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100286,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11202412,"duration_s":0.149489,"completed_at":"2026-08-20T08:55:52.798Z","load_balancing_strategy":"primary","db_duration_s":0.040556,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 432.149079] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"72eaeaed442464f791f49afc","created_at":"2026-08-20T08:55:52.015Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-15afb9ea1ae84f54","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.025Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-72eaeaed442464f791f49afc: start","job_status":"start","queue_duration_s":0.774631,"scheduling_latency_s":0.774654} gitlab # [ 432.165928] gitaly[892]: time="2026-08-20T08:55:52.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64FS2QMJJ95B68PGJKCJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:22.466" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:52.466" grpc.time_ms=0.554 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.179669] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.902Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"72eaeaed442464f791f49afc","created_at":"2026-08-20T08:55:52.015Z","trace_propagation_headers":{"sentry-trace":"cfd4a93df1794a5792c96989be6f8130-15afb9ea1ae84f54","baggage":"sentry-trace_id=cfd4a93df1794a5792c96989be6f8130,sentry-release=Unknown"},"correlation_id":"01M0F61F0K8M1JY4V6P1JTM503","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.025Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-72eaeaed442464f791f49afc: done: 0.102229 sec","job_status":"done","queue_duration_s":0.774631,"scheduling_latency_s":0.774654,"redis_calls":11,"redis_duration_s":0.002806,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001741,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033422,"duration_s":0.102229,"completed_at":"2026-08-20T08:55:52.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.224991] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"afd24676e500cf261cecc76f","created_at":"2026-08-20T08:55:52.205Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.208Z","job_size_bytes":23,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-afd24676e500cf261cecc76f: start","job_status":"start","queue_duration_s":0.695438,"scheduling_latency_s":0.695459} gitlab # [ 432.241556] gitaly[892]: time="2026-08-20T08:55:52.738Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:56:22.736" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:52.737" grpc.time_ms=1.228 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.254157] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.952Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"afd24676e500cf261cecc76f","created_at":"2026-08-20T08:55:52.205Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.208Z","job_size_bytes":23,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-afd24676e500cf261cecc76f: done: 0.048529 sec","job_status":"done","queue_duration_s":0.695438,"scheduling_latency_s":0.695459,"redis_calls":7,"redis_duration_s":0.0019590000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048529,"completed_at":"2026-08-20T08:55:52.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012706,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 432.297223] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.954Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c0a8a800d6965044bc6ca6f8","created_at":"2026-08-20T08:55:52.362Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.364Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c0a8a800d6965044bc6ca6f8: start","job_status":"start","queue_duration_s":0.589948,"scheduling_latency_s":0.589973} gitlab # [ 432.313630] gitaly[892]: time="2026-08-20T08:55:52.785Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64H2NSKB3DPEHSW99PA9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:22.783" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:52.784" grpc.time_ms=1.077 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.326155] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.988Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c0a8a800d6965044bc6ca6f8","created_at":"2026-08-20T08:55:52.362Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.364Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c0a8a800d6965044bc6ca6f8: done: 0.033829 sec","job_status":"done","queue_duration_s":0.589948,"scheduling_latency_s":0.589973,"redis_calls":7,"redis_duration_s":0.002424,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033829,"completed_at":"2026-08-20T08:55:52.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.368930] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:52.990Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0569827f9fcf41d22a1cb7e7","created_at":"2026-08-20T08:55:52.380Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.383Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0569827f9fcf41d22a1cb7e7: start","job_status":"start","queue_duration_s":0.606623,"scheduling_latency_s":0.606646} gitlab # [ 432.386005] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0569827f9fcf41d22a1cb7e7","created_at":"2026-08-20T08:55:52.380Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.383Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0569827f9fcf41d22a1cb7e7: done: 0.033591 sec","job_status":"done","queue_duration_s":0.606623,"scheduling_latency_s":0.606646,"redis_calls":7,"redis_duration_s":0.0019029999999999997,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033591,"completed_at":"2026-08-20T08:55:53.023Z","load_balancing_strategy":"primary","db_duration_s":0.00819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.428829] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.025Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"bbab7bb4d9e5da3add6cda8a","created_at":"2026-08-20T08:55:52.399Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.401Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-bbab7bb4d9e5da3add6cda8a: start","job_status":"start","queue_duration_s":0.624311,"scheduling_latency_s":0.624334} gitlab # [ 432.444576] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"bbab7bb4d9e5da3add6cda8a","created_at":"2026-08-20T08:55:52.399Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.401Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-bbab7bb4d9e5da3add6cda8a: done: 0.03602 sec","job_status":"done","queue_duration_s":0.624311,"scheduling_latency_s":0.624334,"redis_calls":10,"redis_duration_s":0.002828,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000915,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03602,"completed_at":"2026-08-20T08:55:53.061Z","load_balancing_strategy":"primary","db_duration_s":0.008397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.488321] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"57f34d530a06f506708b6209","created_at":"2026-08-20T08:55:52.402Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.404Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-57f34d530a06f506708b6209: start","job_status":"start","queue_duration_s":0.658923,"scheduling_latency_s":0.658947} gitlab # [ 432.504934] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.094Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"57f34d530a06f506708b6209","created_at":"2026-08-20T08:55:52.402Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.404Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-57f34d530a06f506708b6209: done: 0.030607 sec","job_status":"done","queue_duration_s":0.658923,"scheduling_latency_s":0.658947,"redis_calls":7,"redis_duration_s":0.0019359999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030607,"completed_at":"2026-08-20T08:55:53.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.548344] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.095Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0cc827f8a643b10a4d8bb6e6","created_at":"2026-08-20T08:55:52.405Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.408Z","job_size_bytes":19,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0cc827f8a643b10a4d8bb6e6: start","job_status":"start","queue_duration_s":0.687648,"scheduling_latency_s":0.687666} gitlab # [ 432.564596] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.123Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0cc827f8a643b10a4d8bb6e6","created_at":"2026-08-20T08:55:52.405Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.408Z","job_size_bytes":19,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0cc827f8a643b10a4d8bb6e6: done: 0.027763 sec","job_status":"done","queue_duration_s":0.687648,"scheduling_latency_s":0.687666,"redis_calls":8,"redis_duration_s":0.002215,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001754,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027763,"completed_at":"2026-08-20T08:55:53.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005983,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.608345] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.125Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d1403ad1bf37d61975135bee","created_at":"2026-08-20T08:55:52.409Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.411Z","job_size_bytes":66,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d1403ad1bf37d61975135bee: start","job_status":"start","queue_duration_s":0.713856,"scheduling_latency_s":0.713879} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses gitlab # [ 432.625427] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.151Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d1403ad1bf37d61975135bee","created_at":"2026-08-20T08:55:52.409Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.411Z","job_size_bytes":66,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d1403ad1bf37d61975135bee: done: 0.026086 sec","job_status":"done","queue_duration_s":0.713856,"scheduling_latency_s":0.713879,"redis_calls":7,"redis_duration_s":0.001786,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026086,"completed_at":"2026-08-20T08:55:53.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.667876] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.153Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"56dcbca0ae4ebf7c2a8cc674","created_at":"2026-08-20T08:55:52.411Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.415Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-56dcbca0ae4ebf7c2a8cc674: start","job_status":"start","queue_duration_s":0.737246,"scheduling_latency_s":0.737268} gitlab # [ 432.683215] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.181Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"56dcbca0ae4ebf7c2a8cc674","created_at":"2026-08-20T08:55:52.411Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.415Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-56dcbca0ae4ebf7c2a8cc674: done: 0.028153 sec","job_status":"done","queue_duration_s":0.737246,"scheduling_latency_s":0.737268,"redis_calls":7,"redis_duration_s":0.001752,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028153,"completed_at":"2026-08-20T08:55:53.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.725253] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.182Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f6df14b2297bbde48de4a45f","created_at":"2026-08-20T08:55:52.416Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.418Z","job_size_bytes":6,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f6df14b2297bbde48de4a45f: start","job_status":"start","queue_duration_s":0.764556,"scheduling_latency_s":0.764579} gitlab # [ 432.741302] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f6df14b2297bbde48de4a45f","created_at":"2026-08-20T08:55:52.416Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.418Z","job_size_bytes":6,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f6df14b2297bbde48de4a45f: done: 0.015007 sec","job_status":"done","queue_duration_s":0.764556,"scheduling_latency_s":0.764579,"redis_calls":7,"redis_duration_s":0.001708,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015007,"completed_at":"2026-08-20T08:55:53.197Z","load_balancing_strategy":"primary","db_duration_s":0.000623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.783345] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b8c6d9d5eea74013722d3484","created_at":"2026-08-20T08:55:52.418Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.420Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b8c6d9d5eea74013722d3484: start","job_status":"start","queue_duration_s":0.778867,"scheduling_latency_s":0.778883} gitlab # [ 432.800244] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.225Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b8c6d9d5eea74013722d3484","created_at":"2026-08-20T08:55:52.418Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.420Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b8c6d9d5eea74013722d3484: done: 0.025825 sec","job_status":"done","queue_duration_s":0.778867,"scheduling_latency_s":0.778883,"redis_calls":7,"redis_duration_s":0.001815,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000529,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025825,"completed_at":"2026-08-20T08:55:53.225Z","load_balancing_strategy":"primary","db_duration_s":0.005213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.842997] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.226Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a204f7b919c067529eca387b","created_at":"2026-08-20T08:55:52.476Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.478Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a204f7b919c067529eca387b: start","job_status":"start","queue_duration_s":0.748286,"scheduling_latency_s":0.748304} gitlab # [ 432.859229] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.256Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a204f7b919c067529eca387b","created_at":"2026-08-20T08:55:52.476Z","trace_propagation_headers":{"sentry-trace":"3e4e35460e9143f3b534ad7c61e253b1-4375f8e9788f4449","baggage":"sentry-trace_id=3e4e35460e9143f3b534ad7c61e253b1,sentry-release=Unknown"},"correlation_id":"01M0F64FS2QMJJ95B68PGJKCJ5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.478Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a204f7b919c067529eca387b: done: 0.029929 sec","job_status":"done","queue_duration_s":0.748286,"scheduling_latency_s":0.748304,"redis_calls":8,"redis_duration_s":0.0021609999999999997,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001648,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029929,"completed_at":"2026-08-20T08:55:53.256Z","load_balancing_strategy":"primary","db_duration_s":0.006375,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 432.902459] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"da47488102dc2100691925e8","created_at":"2026-08-20T08:55:52.718Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-f00df85af18a45e3","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.720Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-da47488102dc2100691925e8: start","job_status":"start","queue_duration_s":0.537619,"scheduling_latency_s":0.537638} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses, in 0.28 seconds) gitlab # [ 432.919202] gitaly[892]: time="2026-08-20T08:55:53.627Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64JX9S3BC8ABRZ7XSJJWH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:23.424" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:53.625" grpc.time_ms=1.325 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.932153] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 173 gitlab # [ 432.934801] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:53.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"da47488102dc2100691925e8","created_at":"2026-08-20T08:55:52.718Z","trace_propagation_headers":{"sentry-trace":"4de0a9c0be284f2d9068f81557f2c093-f00df85af18a45e3","baggage":"sentry-trace_id=4de0a9c0be284f2d9068f81557f2c093,sentry-release=Unknown"},"correlation_id":"01M0F64H2NSKB3DPEHSW99PA9J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:52.720Z","job_size_bytes":3,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-da47488102dc2100691925e8: done: 0.169555 sec","job_status":"done","queue_duration_s":0.537619,"scheduling_latency_s":0.537638,"redis_calls":7,"redis_duration_s":0.001915,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.156934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.169555,"completed_at":"2026-08-20T08:55:53.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses gitlab # [ 434.089173] gitaly[892]: time="2026-08-20T08:55:54.858Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64M43G1W08N9Z0G74CZ7Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:24.455" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:54.856" grpc.time_ms=1.435 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses, in 0.22 seconds) gitlab # [ 434.143073] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 156 gitlab # [ 434.423502] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"fdf9daadf47bc8618f72a655","created_at":"2026-08-20T08:55:55.165Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2c98cadb09ae1933ef2970a76b5c890","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.185Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-fdf9daadf47bc8618f72a655: start","job_status":"start","queue_duration_s":0.005104,"scheduling_latency_s":0.005164} gitlab # [ 434.570438] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"fdf9daadf47bc8618f72a655","created_at":"2026-08-20T08:55:55.165Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2c98cadb09ae1933ef2970a76b5c890","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.185Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-fdf9daadf47bc8618f72a655: done: 0.146341 sec","job_status":"done","queue_duration_s":0.005104,"scheduling_latency_s":0.005164,"redis_calls":9,"redis_duration_s":0.016262000000000002,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002995,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.146341,"completed_at":"2026-08-20T08:55:55.336Z","load_balancing_strategy":"primary","db_duration_s":0.038208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 434.661492] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a656c1be6680e7c18849d212","created_at":"2026-08-20T08:55:55.199Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab325fd198df66764d1ef2f85aa647bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.214Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a656c1be6680e7c18849d212: start","job_status":"start","queue_duration_s":0.130344,"scheduling_latency_s":0.130389} gitlab # [ 434.872315] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a656c1be6680e7c18849d212","created_at":"2026-08-20T08:55:55.199Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab325fd198df66764d1ef2f85aa647bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.214Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a656c1be6680e7c18849d212: done: 0.296681 sec","job_status":"done","queue_duration_s":0.130344,"scheduling_latency_s":0.130389,"redis_calls":13,"redis_duration_s":0.037349,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00906,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.020255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00222412,"exclusive_lock_hold_duration_s":0.13317516,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.296681,"completed_at":"2026-08-20T08:55:55.640Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 434.974004] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"06de5e42cae1b821467934c6","created_at":"2026-08-20T08:55:55.220Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ccc7606f6f660390a119cbe35089b65","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.248Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-06de5e42cae1b821467934c6: start","job_status":"start","queue_duration_s":0.465406,"scheduling_latency_s":0.465458} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses gitlab # [ 435.088577] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"06de5e42cae1b821467934c6","created_at":"2026-08-20T08:55:55.220Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ccc7606f6f660390a119cbe35089b65","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.248Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-06de5e42cae1b821467934c6: done: 0.140657 sec","job_status":"done","queue_duration_s":0.465406,"scheduling_latency_s":0.465458,"redis_calls":11,"redis_duration_s":0.031577,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.014046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00336736,"exclusive_lock_hold_duration_s":0.00710834,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.140657,"completed_at":"2026-08-20T08:55:55.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 435.192977] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ae717d2f9d835fbfe0cb80e5","created_at":"2026-08-20T08:55:55.278Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6228f641e523d0b3b5e62c7b389e5e76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.351Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ae717d2f9d835fbfe0cb80e5: start","job_status":"start","queue_duration_s":0.51609,"scheduling_latency_s":0.51614} gitlab # [ 435.214985] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.954Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 435.225640] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ae717d2f9d835fbfe0cb80e5","created_at":"2026-08-20T08:55:55.278Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6228f641e523d0b3b5e62c7b389e5e76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.351Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ae717d2f9d835fbfe0cb80e5: done: 0.127081 sec","job_status":"done","queue_duration_s":0.51609,"scheduling_latency_s":0.51614,"redis_calls":9,"redis_duration_s":0.019445,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.01113,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004713,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127081,"completed_at":"2026-08-20T08:55:55.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 435.278206] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:55.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"d0337bcf2ff8367eeef15c3c","created_at":"2026-08-20T08:55:55.375Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.396Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-d0337bcf2ff8367eeef15c3c: start","job_status":"start","queue_duration_s":0.60224,"scheduling_latency_s":0.60229} gitlab # [ 435.307986] gitaly[892]: time="2026-08-20T08:55:56.077Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64NA8FX2BBQ2QQ2Y90B8F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:26.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:56.075" grpc.time_ms=1.039 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.357131] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 149 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses, in 0.22 seconds) gitlab # [ 435.513361] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"d0337bcf2ff8367eeef15c3c","created_at":"2026-08-20T08:55:55.375Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.396Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-d0337bcf2ff8367eeef15c3c: done: 0.281982 sec","job_status":"done","queue_duration_s":0.60224,"scheduling_latency_s":0.60229,"redis_calls":28,"redis_duration_s":0.06588,"redis_read_bytes":36,"redis_write_bytes":10583,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003591,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.001287,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8295,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.047845,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.013157,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00285012,"duration_s":0.281982,"completed_at":"2026-08-20T08:55:56.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 435.596891] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bdc388b13c55f8304cd8c43a","created_at":"2026-08-20T08:55:55.420Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88ccad537600fb78f87445535199ee38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:55:55.448Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bdc388b13c55f8304cd8c43a: start","job_status":"start","queue_duration_s":0.842732,"scheduling_latency_s":0.842782} gitlab # [ 435.622847] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.389Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 435.717853] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bdc388b13c55f8304cd8c43a","created_at":"2026-08-20T08:55:55.420Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88ccad537600fb78f87445535199ee38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:55:55.448Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bdc388b13c55f8304cd8c43a: done: 0.194762 sec","job_status":"done","queue_duration_s":0.842732,"scheduling_latency_s":0.842782,"redis_calls":9,"redis_duration_s":0.056657,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01422,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.038842,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.194762,"completed_at":"2026-08-20T08:55:56.485Z","load_balancing_strategy":"primary","db_duration_s":0.004881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 435.808869] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a0548e26444d19733d9ece9f","created_at":"2026-08-20T08:55:55.482Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4278a92ad51409c4fe27002ef1224647","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.522Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a0548e26444d19733d9ece9f: start","job_status":"start","queue_duration_s":0.974622,"scheduling_latency_s":0.974669} gitlab # [ 436.177086] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a0548e26444d19733d9ece9f","created_at":"2026-08-20T08:55:55.482Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4278a92ad51409c4fe27002ef1224647","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.522Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a0548e26444d19733d9ece9f: done: 0.449849 sec","job_status":"done","queue_duration_s":0.974622,"scheduling_latency_s":0.974669,"redis_calls":564,"redis_duration_s":0.10144199999999999,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002183,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.089598,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.345826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.449849,"completed_at":"2026-08-20T08:55:56.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.225527] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"26fbcb5040b643f690d44db1","created_at":"2026-08-20T08:55:55.543Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d9bf01fae57c1af7fc0d708b3718ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:55:55.566Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-26fbcb5040b643f690d44db1: start","job_status":"start","queue_duration_s":1.381936,"scheduling_latency_s":1.38196} gitlab # [ 436.239266] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.962Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 436.243211] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"26fbcb5040b643f690d44db1","created_at":"2026-08-20T08:55:55.543Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d9bf01fae57c1af7fc0d708b3718ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:55:55.566Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-26fbcb5040b643f690d44db1: done: 0.020912 sec","job_status":"done","queue_duration_s":1.381936,"scheduling_latency_s":1.38196,"redis_calls":9,"redis_duration_s":0.0023350000000000003,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020912,"completed_at":"2026-08-20T08:55:56.969Z","load_balancing_strategy":"primary","db_duration_s":0.0009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.285073] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:56.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2fd37eba24f80181d07a03e0","created_at":"2026-08-20T08:55:55.601Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8046efbced3cbc62814c1b6eb1108a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.632Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2fd37eba24f80181d07a03e0: start","job_status":"start","queue_duration_s":1.338411,"scheduling_latency_s":1.338431} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses, in 0.22 seconds) gitlab # [ 436.504188] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2fd37eba24f80181d07a03e0","created_at":"2026-08-20T08:55:55.601Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8046efbced3cbc62814c1b6eb1108a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.632Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2fd37eba24f80181d07a03e0: done: 0.301832 sec","job_status":"done","queue_duration_s":1.338411,"scheduling_latency_s":1.338431,"redis_calls":11,"redis_duration_s":0.003844,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.054,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.223698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058064,"exclusive_lock_hold_duration_s":0.26942572,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.301832,"completed_at":"2026-08-20T08:55:57.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.084062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.589650] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"24439401f2d83dec90e51bd1","created_at":"2026-08-20T08:55:55.707Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dbf3212cd579cd5fbc6fbcc8d0565ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.723Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-24439401f2d83dec90e51bd1: start","job_status":"start","queue_duration_s":1.553046,"scheduling_latency_s":1.553096} gitlab # [ 436.610177] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"24439401f2d83dec90e51bd1","created_at":"2026-08-20T08:55:55.707Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dbf3212cd579cd5fbc6fbcc8d0565ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.723Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-24439401f2d83dec90e51bd1: done: 0.045706 sec","job_status":"done","queue_duration_s":1.553046,"scheduling_latency_s":1.553096,"redis_calls":11,"redis_duration_s":0.0052770000000000004,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001186,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003558,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045706,"completed_at":"2026-08-20T08:55:57.322Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.658127] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 153 gitlab # [ 436.661147] gitaly[892]: time="2026-08-20T08:55:57.296Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64PGC98HDT56DYVAW0J8S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:27.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:57.294" grpc.time_ms=1.132 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.674104] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.324Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c8bd6133664e15f1ab84a0b","created_at":"2026-08-20T08:55:55.742Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d3c22352ddeacb4fefc6a29be1a99fc","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.767Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c8bd6133664e15f1ab84a0b: start","job_status":"start","queue_duration_s":1.556638,"scheduling_latency_s":1.556675} gitlab # [ 436.688889] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c8bd6133664e15f1ab84a0b","created_at":"2026-08-20T08:55:55.742Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d3c22352ddeacb4fefc6a29be1a99fc","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.767Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c8bd6133664e15f1ab84a0b: done: 0.051388 sec","job_status":"done","queue_duration_s":1.556638,"scheduling_latency_s":1.556675,"redis_calls":12,"redis_duration_s":0.003579,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001601,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001542,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0140975,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.051388,"completed_at":"2026-08-20T08:55:57.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004366,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 436.733940] gitaly[892]: time="2026-08-20T08:55:57.400Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64PMF6T9CBBWY2HKRK6RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:27.299" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:57.399" grpc.time_ms=0.946 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.771601] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0f3788d1f94a667e9b4c3021","created_at":"2026-08-20T08:55:55.786Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a44b787d045391ced0edc0809a8f6f94","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.811Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0f3788d1f94a667e9b4c3021: start","job_status":"start","queue_duration_s":1.566069,"scheduling_latency_s":1.566101} gitlab # [ 436.803124] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0f3788d1f94a667e9b4c3021","created_at":"2026-08-20T08:55:55.786Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a44b787d045391ced0edc0809a8f6f94","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.811Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0f3788d1f94a667e9b4c3021: done: 0.048164 sec","job_status":"done","queue_duration_s":1.566069,"scheduling_latency_s":1.566101,"redis_calls":18,"redis_duration_s":0.005671,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001046,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000403,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003249,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048164,"completed_at":"2026-08-20T08:55:57.425Z","load_balancing_strategy":"primary","db_duration_s":0.003945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.861932] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 194 gitlab # [ 436.864710] gitaly[892]: time="2026-08-20T08:55:57.455Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64PMF6T9CBBWY2HKRK6RZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:07.232" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:57.444" grpc.time_ms=10.858 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.878838] nixbot[3534]: {"ts": "2026-08-20T08:55:57.519Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 \"HTTP/1.1 201 Created\""} gitlab # [ 436.881747] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3588a74a4fd3ff5960767567","created_at":"2026-08-20T08:55:55.842Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e605631aa4693c94a6700c6adb4705b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.865Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3588a74a4fd3ff5960767567: start","job_status":"start","queue_duration_s":1.562649,"scheduling_latency_s":1.562678} gitlab # [ 436.896314] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.441Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 436.899588] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3588a74a4fd3ff5960767567","created_at":"2026-08-20T08:55:55.842Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e605631aa4693c94a6700c6adb4705b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.865Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3588a74a4fd3ff5960767567: done: 0.022313 sec","job_status":"done","queue_duration_s":1.562649,"scheduling_latency_s":1.562678,"redis_calls":9,"redis_duration_s":0.002236,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000568,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022313,"completed_at":"2026-08-20T08:55:57.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.943421] gitaly[892]: time="2026-08-20T08:55:57.574Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64PTM4AETZE72SHCVT304 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:27.173" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:57.573" grpc.time_ms=1.144 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.957614] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 184 gitlab # [ 436.960422] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"429e768fe54382e33158e581","created_at":"2026-08-20T08:55:55.897Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bca3d2aeb39e0ab82e2382d8bf7ea2ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.910Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-429e768fe54382e33158e581: start","job_status":"start","queue_duration_s":1.540764,"scheduling_latency_s":1.540784} gitlab # [ 436.974928] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"429e768fe54382e33158e581","created_at":"2026-08-20T08:55:55.897Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bca3d2aeb39e0ab82e2382d8bf7ea2ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.910Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-429e768fe54382e33158e581: done: 0.019954 sec","job_status":"done","queue_duration_s":1.540764,"scheduling_latency_s":1.540784,"redis_calls":9,"redis_duration_s":0.002095,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019954,"completed_at":"2026-08-20T08:55:57.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.016894] nixbot[3534]: {"ts": "2026-08-20T08:55:57.707Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 \"HTTP/1.1 201 Created\""} gitlab # [ 437.019626] gitaly[892]: time="2026-08-20T08:55:57.618Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0F64PTM4AETZE72SHCVT304 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:07.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:57.608" grpc.time_ms=9.724 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.033313] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.472Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"885463b0705482d73240b322","created_at":"2026-08-20T08:55:55.956Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4b3e84136f812ea523615a5248bf248","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.990Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-885463b0705482d73240b322: start","job_status":"start","queue_duration_s":1.481843,"scheduling_latency_s":1.481859} gitlab # [ 437.046890] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"885463b0705482d73240b322","created_at":"2026-08-20T08:55:55.956Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4b3e84136f812ea523615a5248bf248","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:55.990Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-885463b0705482d73240b322: done: 0.028246 sec","job_status":"done","queue_duration_s":1.481843,"scheduling_latency_s":1.481859,"redis_calls":11,"redis_duration_s":0.003179,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061014,"exclusive_lock_hold_duration_s":0.00739376,"duration_s":0.028246,"completed_at":"2026-08-20T08:55:57.500Z","load_balancing_strategy":"primary","db_duration_s":0.004107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.088316] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b0535a712034ac9a05dd02f8","created_at":"2026-08-20T08:55:56.059Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e427e612cab28ccac5a3cb0eef66b2f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.089Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b0535a712034ac9a05dd02f8: start","job_status":"start","queue_duration_s":1.413189,"scheduling_latency_s":1.413205} gitlab # [ 437.102892] gitaly[892]: time="2026-08-20T08:55:57.792Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64Q0VJTGE3ENNR98NMAMG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:56:27.589" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:55:57.789" grpc.time_ms=1.645 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.115460] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.513Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 437.119232] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b0535a712034ac9a05dd02f8","created_at":"2026-08-20T08:55:56.059Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e427e612cab28ccac5a3cb0eef66b2f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.089Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b0535a712034ac9a05dd02f8: done: 0.135875 sec","job_status":"done","queue_duration_s":1.413189,"scheduling_latency_s":1.413205,"redis_calls":9,"redis_duration_s":0.001374,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.135875,"completed_at":"2026-08-20T08:55:57.638Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.162721] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"971fb63e6f3f50e878dd7f39","created_at":"2026-08-20T08:55:56.138Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0e865f8f4757775da3a34106d102971","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.167Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-971fb63e6f3f50e878dd7f39: start","job_status":"start","queue_duration_s":1.472193,"scheduling_latency_s":1.472215} gitlab # [ 437.177255] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.651Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 437.180383] gitaly[892]: time="2026-08-20T08:55:57.839Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F64Q0VJTGE3ENNR98NMAMG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:56:07.287" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:57.828" grpc.time_ms=9.969 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.193827] nixbot[3534]: {"ts": "2026-08-20T08:55:57.891Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 \"HTTP/1.1 201 Created\""} gitlab # [ 437.196600] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/44a1efac2b8d495c798a775011ad0b5e92463652 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 164 gitlab # [ 437.199090] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"971fb63e6f3f50e878dd7f39","created_at":"2026-08-20T08:55:56.138Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0e865f8f4757775da3a34106d102971","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.167Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-971fb63e6f3f50e878dd7f39: done: 0.019846 sec","job_status":"done","queue_duration_s":1.472193,"scheduling_latency_s":1.472215,"redis_calls":9,"redis_duration_s":0.001507,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000337,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019846,"completed_at":"2026-08-20T08:55:57.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.241365] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"ba0619101d9af3e2b7ed55a6","created_at":"2026-08-20T08:55:56.201Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1f0d6c68021aea29244e5507e0b850c","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.226Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-ba0619101d9af3e2b7ed55a6: start","job_status":"start","queue_duration_s":1.434243,"scheduling_latency_s":1.434263} gitlab # [ 437.254856] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"ba0619101d9af3e2b7ed55a6","created_at":"2026-08-20T08:55:56.201Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1f0d6c68021aea29244e5507e0b850c","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.226Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-ba0619101d9af3e2b7ed55a6: done: 0.031437 sec","job_status":"done","queue_duration_s":1.434243,"scheduling_latency_s":1.434263,"redis_calls":10,"redis_duration_s":0.0018449999999999999,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031438,"duration_s":0.031437,"completed_at":"2026-08-20T08:55:57.692Z","load_balancing_strategy":"primary","db_duration_s":0.006046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.296202] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c05ae21e1df6f65b8ebb1f6a","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c05ae21e1df6f65b8ebb1f6a: start","job_status":"start","queue_duration_s":1.456229,"scheduling_latency_s":1.456572} gitlab # [ 437.309503] nix-daemon[3746]: accepted connection from pid 4486, user nixbot gitlab # [ 437.310487] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c05ae21e1df6f65b8ebb1f6a","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c05ae21e1df6f65b8ebb1f6a: done: 0.049786 sec","job_status":"done","queue_duration_s":1.456229,"scheduling_latency_s":1.456572,"redis_calls":16,"redis_duration_s":0.0041199999999999995,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00228,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050078,"duration_s":0.049786,"completed_at":"2026-08-20T08:55:57.743Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.353093] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b67f7ebf2700cec57cf1ae5d","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b67f7ebf2700cec57cf1ae5d: start","job_status":"start","queue_duration_s":1.508204,"scheduling_latency_s":1.50824} gitlab # [ 437.366295] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b67f7ebf2700cec57cf1ae5d","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b67f7ebf2700cec57cf1ae5d: done: 0.028651 sec","job_status":"done","queue_duration_s":1.508204,"scheduling_latency_s":1.50824,"redis_calls":13,"redis_duration_s":0.003922,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028651,"completed_at":"2026-08-20T08:55:57.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.406458] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"460be17c698ee5583aec4c44","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-460be17c698ee5583aec4c44: start","job_status":"start","queue_duration_s":1.538545,"scheduling_latency_s":1.538569} gitlab # [ 437.419802] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 66 gitlab # [ 437.422024] gitlab-workhorse[814]: time="2026-08-20T08:55:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 437.423826] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 73 gitlab # [ 437.425840] gitaly[892]: time="2026-08-20T08:55:58.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F64QAYHV798QT84HJZSMK9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:58.098" grpc.time_ms=12.045 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 437.439202] gitaly[892]: time="2026-08-20T08:55:58.186Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64QD2NYHJGN0FB4GXQNZX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:58.174" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 437.449616] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"460be17c698ee5583aec4c44","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-460be17c698ee5583aec4c44: done: 0.020922 sec","job_status":"done","queue_duration_s":1.538545,"scheduling_latency_s":1.538569,"redis_calls":13,"redis_duration_s":0.003217,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002267,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020922,"completed_at":"2026-08-20T08:55:57.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.489317] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"27b4a80ff5d49f5396aeaa2b","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-27b4a80ff5d49f5396aeaa2b: start","job_status":"start","queue_duration_s":1.560921,"scheduling_latency_s":1.560945} gitlab # [ 437.502788] gitaly[892]: time="2026-08-20T08:55:58.186Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64QD2NYHJGN0FB4GXQNZX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:58.174" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 437.516452] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"27b4a80ff5d49f5396aeaa2b","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-27b4a80ff5d49f5396aeaa2b: done: 0.019607 sec","job_status":"done","queue_duration_s":1.560921,"scheduling_latency_s":1.560945,"redis_calls":13,"redis_duration_s":0.001833,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019607,"completed_at":"2026-08-20T08:55:57.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.557252] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"276044f1438ae5f95dcec83b","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-276044f1438ae5f95dcec83b: start","job_status":"start","queue_duration_s":1.582811,"scheduling_latency_s":1.582835} gitlab # [ 437.571129] gitaly[892]: time="2026-08-20T08:55:58.187Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F64QD2NYHJGN0FB4GXQNZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:55:58.174" grpc.time_ms=12.797 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses gitlab # [ 437.585827] nix-daemon[3746]: accepted connection from pid 4511, user nixbot gitlab # [ 437.586732] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"276044f1438ae5f95dcec83b","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-276044f1438ae5f95dcec83b: done: 0.020546 sec","job_status":"done","queue_duration_s":1.582811,"scheduling_latency_s":1.582835,"redis_calls":13,"redis_duration_s":0.00197,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020546,"completed_at":"2026-08-20T08:55:57.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.623807] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"64a12217192d47a07bd08c5b","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-64a12217192d47a07bd08c5b: start","job_status":"start","queue_duration_s":1.604683,"scheduling_latency_s":1.604707} gitlab # [ 437.637859] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"64a12217192d47a07bd08c5b","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-64a12217192d47a07bd08c5b: done: 0.016966 sec","job_status":"done","queue_duration_s":1.604683,"scheduling_latency_s":1.604707,"redis_calls":13,"redis_duration_s":0.0015109999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016966,"completed_at":"2026-08-20T08:55:57.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.678257] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1610702510fddce514d9d4a4","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1610702510fddce514d9d4a4: start","job_status":"start","queue_duration_s":1.622843,"scheduling_latency_s":1.622886} gitlab # [ 437.691887] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1610702510fddce514d9d4a4","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1610702510fddce514d9d4a4: done: 0.016785 sec","job_status":"done","queue_duration_s":1.622843,"scheduling_latency_s":1.622886,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016785,"completed_at":"2026-08-20T08:55:57.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.732277] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d7accca08d82b09eebe6d3d6","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d7accca08d82b09eebe6d3d6: start","job_status":"start","queue_duration_s":1.64148,"scheduling_latency_s":1.641505} gitlab # [ 437.745338] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d7accca08d82b09eebe6d3d6","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d7accca08d82b09eebe6d3d6: done: 0.017101 sec","job_status":"done","queue_duration_s":1.64148,"scheduling_latency_s":1.641505,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017101,"completed_at":"2026-08-20T08:55:57.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.786361] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"eec21047696a2a821e425f7a","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-eec21047696a2a821e425f7a: start","job_status":"start","queue_duration_s":1.659785,"scheduling_latency_s":1.659808} gitlab # [ 437.799842] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"eec21047696a2a821e425f7a","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-eec21047696a2a821e425f7a: done: 0.0175 sec","job_status":"done","queue_duration_s":1.659785,"scheduling_latency_s":1.659808,"redis_calls":13,"redis_duration_s":0.002128,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001611,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0175,"completed_at":"2026-08-20T08:55:57.915Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.839779] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f24e6a64d720cefc7a2963a","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f24e6a64d720cefc7a2963a: start","job_status":"start","queue_duration_s":1.678503,"scheduling_latency_s":1.678526} gitlab # [ 437.855128] gitaly[892]: time="2026-08-20T08:55:58.546Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64PMF6T9CBBWY2HKRK6RZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:58.545" grpc.time_ms=0.66 pid=892 span.kind=server system=grpc gitlab # [ 437.873967] gitaly[892]: time="2026-08-20T08:55:58.579Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64PMF6T9CBBWY2HKRK6RZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:58.577" grpc.time_ms=2.688 pid=892 span.kind=server system=grpc gitlab # [ 437.890607] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f24e6a64d720cefc7a2963a","created_at":"2026-08-20T08:55:56.086Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-30310cf211ba4edc","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a1ec442e01632b647b9425ad1ed732d6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.237Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f24e6a64d720cefc7a2963a: done: 0.020018 sec","job_status":"done","queue_duration_s":1.678503,"scheduling_latency_s":1.678526,"redis_calls":13,"redis_duration_s":0.003189,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002351,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020018,"completed_at":"2026-08-20T08:55:57.936Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses, in 0.36 seconds) (finished: subtest: eval and build post commit statuses, in 6.47 seconds) (finished: run the VM test script, in 510.13 seconds) gitlab # [ 437.942926] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"7202395c8669d1a010a50238","created_at":"2026-08-20T08:55:56.248Z","trace_propagation_headers":{"sentry-trace":"0080862bf30446c08009403ac7afbd87-dc55bc0c325f49cd","baggage":"sentry-trace_id=0080862bf30446c08009403ac7afbd87,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a192c6ccf0b8eea00d7115339a1d1de1","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T08:55:56.276Z","job_size_bytes":2,"pid":3456,"sidekiq_tid":"m8rs","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-7202395c8669d1a010a50238: start","job_status":"start","queue_duration_s":1.662374,"scheduling_latency_s":1.662403} gitlab # [ 437.959065] gitaly[892]: time="2026-08-20T08:55:58.620Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F64PMF6T9CBBWY2HKRK6RZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:55:58.619" grpc.time_ms=1.026 pid=892 span.kind=server system=grpc gitlab # [ 437.972817] gitaly[892]: time="2026-08-20T08:55:58.624Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0F64PMF6T9CBBWY2HKRK6RZ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:56:28.495" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:55:58.495" operations="[repack_refs]" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root test script finished in 510.17s cleanup gitlab # [ 437.986398] gitlab-workhorse[814]: gitlab 2001:db8:1::1 - - [2026/08/20:08:55:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/44a1efac2b8d495c798a775011ad0b5e92463652/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 249 kill QemuMachine (pid 46) gitlab # [ 437.989369] sidekiq-cluster[3456]: {"severity":"INFO","time":"2026-08-20T08:55:57.967Z","retry"qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.49 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T08:54:16.140Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T08:55:51.630315Z', 'started_at': '2026-08-20T08:55:52.005780Z', 'finished_at': None}] [{'id': 5, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:55:51.976Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:55:51.976Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:55:51.976Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:55:51.976Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:55:51.976Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T08:55:51.976Z', 'started_at': None, 'finished_at': '2026-08-20T08:55:57.481Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '44a1efac2b8d495c798a775011ad0b5e92463652', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T08:55:57.663Z', 'started_at': None, 'finished_at': '2026-08-20T08:55:57.861Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]