tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.G02Y2VwYWh', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 70.09 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: ca07a530-f0a6-48fe-849a-9de1558a55a6 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qmqxwkz0njs33kfa9f76yvdnszdsbwwf-nixos-system-gitlab-test/init regInfo=/nix/store/r15xv45fcamgrxpdcb1103w7p3glg0pi-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/r15xv45fcamgrxpdcb1103w7p3glg0pi-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000028] arm-pv: using stolen time PV gitlab # [ 0.000363] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000549] Console: colour dummy device 80x25 gitlab # [ 0.000556] printk: legacy console [tty0] enabled gitlab # [ 0.000755] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000762] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000830] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000961] landlock: Up and running. gitlab # [ 0.000964] Yama: becoming mindful. gitlab # [ 0.001378] LSM support for eBPF active gitlab # [ 0.001543] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001648] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002784] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003429] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003434] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003569] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004578] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004690] EFI services will not be available. gitlab # [ 0.004851] smp: Bringing up secondary CPUs ... gitlab # [ 0.005478] Detected PIPT I-cache on CPU1 gitlab # [ 0.005577] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005699] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.005821] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.006931] Detected PIPT I-cache on CPU2 gitlab # [ 0.007038] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007160] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.007282] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008328] Detected PIPT I-cache on CPU3 gitlab # [ 0.008444] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008568] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.008704] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009222] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009248] SMP: Total of 4 processors activated. gitlab # [ 0.009251] CPU: All CPU(s) started at EL1 gitlab # [ 0.009259] CPU features: detected: Branch Target Identification gitlab # [ 0.009263] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009266] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009269] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009273] CPU features: detected: Common not Private translations gitlab # [ 0.009276] CPU features: detected: CRC32 instructions gitlab # [ 0.009278] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009282] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009285] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009288] CPU features: detected: E0PD gitlab # [ 0.009290] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009293] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009296] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009299] CPU features: detected: Fine Grained Traps gitlab # [ 0.009301] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009306] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009308] CPU features: detected: LSE atomic instructions gitlab # [ 0.009311] CPU features: detected: Privileged Access Never gitlab # [ 0.009314] CPU features: detected: PMUv3 gitlab # [ 0.009316] CPU features: detected: RAS Extension Support gitlab # [ 0.009319] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009321] CPU features: detected: Random Number Generator gitlab # [ 0.009323] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009326] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009328] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009332] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009463] alternatives: applying system-wide alternatives gitlab # [ 0.012410] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012658] Memory: 5963792K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014099] devtmpfs: initialized gitlab # [ 0.018267] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018330] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018539] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018543] 0 pages in range for non-PLT usage gitlab # [ 0.018545] 508288 pages in range for PLT usage gitlab # [ 0.018636] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019448] DMI not present or invalid. gitlab # [ 0.022565] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.024978] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025264] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027165] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027186] audit: initializing netlink subsys (disabled) gitlab # [ 0.027524] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.027990] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.027993] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.027997] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.028000] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.028002] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028088] cpuidle: using governor ladder gitlab # [ 0.028110] cpuidle: using governor menu gitlab # [ 0.028306] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.028532] ASID allocator initialised with 65536 entries gitlab # [ 0.029664] Serial: AMBA PL011 UART driver gitlab # [ 0.034702] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.034988] printk: console [ttyAMA0] enabled gitlab # [ 0.047257] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.047279] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.047289] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.047297] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.047306] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.047314] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.047322] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.047330] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059393] fbcon: Taking over console gitlab # [ 0.059404] ACPI: Interpreter disabled. gitlab # [ 0.060340] iommu: Default domain type: Translated gitlab # [ 0.060345] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.069407] SCSI subsystem initialized gitlab # [ 0.069798] usbcore: registered new interface driver usbfs gitlab # [ 0.069822] usbcore: registered new interface driver hub gitlab # [ 0.069849] usbcore: registered new device driver usb gitlab # [ 0.070147] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.070152] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.070161] PTP clock support registered gitlab # [ 0.070202] EDAC MC: Ver: 3.0.0 gitlab # [ 0.070651] scmi_core: SCMI protocol bus registered gitlab # [ 0.071160] FPGA manager framework gitlab # [ 0.071988] vgaarb: loaded gitlab # [ 0.073505] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.077598] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.077625] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.081832] netfs: FS-Cache loaded gitlab # [ 0.081970] pnp: PnP ACPI: disabled gitlab # [ 0.087681] NET: Registered PF_INET protocol family gitlab # [ 0.088597] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.116833] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.116887] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.116935] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.117237] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.117842] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.117939] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.117991] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.118103] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.118289] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.118308] NET: Registered PF_XDP protocol family gitlab # [ 0.118323] PCI: CLS 0 bytes, default 64 gitlab # [ 0.118653] Trying to unpack rootfs image as initramfs... gitlab # [ 0.133616] kvm [1]: HYP mode not available gitlab # [ 0.179411] Initialise system trusted keyrings gitlab # [ 0.181740] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.183789] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.183957] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.222409] Key type asymmetric registered gitlab # [ 0.222422] Asymmetric key parser 'x509' registered gitlab # [ 0.222743] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.223084] io scheduler mq-deadline registered gitlab # [ 0.223096] io scheduler kyber registered gitlab # [ 0.237313] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.245579] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.246839] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.246875] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.246900] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.246914] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.246979] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.247050] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.247477] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.247499] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.247510] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.247519] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.247529] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.247784] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.249272] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.249990] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.250029] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.250125] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.250162] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.251676] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.252347] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.252383] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.252472] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.254027] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.254674] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.254710] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.254801] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.256339] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.257005] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.257042] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.257144] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.258741] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.259401] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.259437] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.259516] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.261097] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.261718] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.261754] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.261833] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.263399] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.264004] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.264040] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.264120] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.264156] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.265821] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.266446] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.266526] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.268083] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.268686] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.268766] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.270137] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.270783] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.271578] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.272318] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.272355] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.272434] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.274033] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.274700] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.274747] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.274838] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.276705] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.276724] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.276734] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.276877] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.277019] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.277165] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.277307] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.277456] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.277622] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.277757] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.277912] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.278066] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.278266] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.278414] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.278469] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.278546] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.278603] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.278657] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.278712] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.278766] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.278822] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.278879] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.278937] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.278994] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.279051] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.279105] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.279158] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.279210] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.279263] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.279318] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.279372] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.279427] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.279481] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.279537] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.279602] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.279618] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.279627] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.283764] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.318662] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.324069] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.329703] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.335956] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.341023] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.347593] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.352672] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.359080] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.364361] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.369374] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.376106] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.388734] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.392545] msm_serial: driver initialized gitlab # [ 0.392884] SuperH (H)SCI(F) driver initialized gitlab # [ 0.393002] STM32 USART driver initialized gitlab # [ 0.428363] loop: module loaded gitlab # [ 0.428792] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.432205] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.435592] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.438947] virtio_blk virtio5: [vdb] 12227680 512-byte logical blocks (6.26 GB/5.83 GiB) gitlab # [ 0.442768] megasas: 07.734.00.00-rc1 gitlab # [ 0.444130] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.447319] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.447348] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.450024] Using buffer write method gitlab # [ 0.450076] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.453300] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.453330] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.457253] Using buffer write method gitlab # [ 0.457278] Concatenating MTD devices: gitlab # [ 0.457282] (0): "0.flash" gitlab # [ 0.457286] (1): "0.flash" gitlab # [ 0.457290] into device "0.flash" gitlab # [ 0.578314] Freeing initrd memory: 27184K gitlab # [ 0.597565] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.606703] thunder_xcv, ver 1.0 gitlab # [ 0.606809] thunder_bgx, ver 1.0 gitlab # [ 0.606894] nicpf, ver 1.0 gitlab # [ 0.608615] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.608627] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.608721] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.608736] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.608809] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.608819] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.608906] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.608917] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.609308] sky2: driver version 1.30 gitlab # [ 0.614543] usbcore: registered new interface driver usb-storage gitlab # [ 0.614635] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.614740] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.614982] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.615043] usbserial: USB Serial support registered for generic gitlab # [ 0.615359] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.616871] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.619568] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.619629] rtc-pl031 9010000.pl031: setting system clock to 2026-08-23T16:51:55 UTC (1787503915) gitlab # [ 0.620538] i2c_dev: i2c /dev entries driver gitlab # [ 0.625619] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.626645] hub 1-0:1.0: USB hub found gitlab # [ 0.626692] hub 1-0:1.0: 6 ports detected gitlab # [ 0.629006] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.629020] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.629769] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.630782] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.635194] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.636003] usbcore: registered new interface driver usbhid gitlab # [ 0.636014] usbhid: USB HID core driver gitlab # [ 0.642356] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.646340] drop_monitor: Initializing network drop monitor service gitlab # [ 0.646656] NET: Registered PF_INET6 protocol family gitlab # [ 0.648236] Segment Routing with IPv6 gitlab # [ 0.648266] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.648345] NET: Registered PF_PACKET protocol family gitlab # [ 0.648561] 9pnet: Installing 9P2000 support gitlab # [ 0.652570] Key type dns_resolver registered gitlab # [ 0.667947] registered taskstats version 1 gitlab # [ 0.668380] Loading compiled-in X.509 certificates gitlab # [ 0.687853] Demotion targets for Node 0: null gitlab # [ 0.688103] Key type .fscrypt registered gitlab # [ 0.688110] Key type fscrypt-provisioning registered gitlab # [ 0.688277] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.688298] ima: Allocated hash algorithm: sha1 gitlab # [ 0.688352] ima: No architecture policies found gitlab # [ 0.689536] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.714982] clk: Disabling unused clocks gitlab # [ 0.715014] PM: genpd: Disabling unused power domains gitlab # [ 0.719641] Freeing unused kernel memory: 4736K gitlab # [ 0.719848] Run /init as init process gitlab # [ 0.752234] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.873638] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.026251] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.086666] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.086734] systemd[1]: Detected virtualization qemu. gitlab # [ 1.086804] systemd[1]: Detected architecture arm64. gitlab # [ 1.086821] systemd[1]: Running in initrd. gitlab # [ 1.087661] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.087927] systemd[1]: Hostname set to . gitlab # [ 1.162294] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.285582] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.386884] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.441963] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.442489] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.498795] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.527026] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.527511] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.527573] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.527597] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.527640] systemd[1]: Reached target Path Units. gitlab # [ 1.527671] systemd[1]: Reached target Slice Units. gitlab # [ 1.527703] systemd[1]: Reached target Swaps. gitlab # [ 1.527738] systemd[1]: Reached target Timer Units. gitlab # [ 1.528066] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.528375] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.528699] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.529059] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.529232] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.529271] systemd[1]: Reached target Socket Units. gitlab # [ 1.532514] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.535964] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.536107] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.541853] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.571289] systemd[1]: Starting Journal Service... gitlab # [ 1.576442] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.576776] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.580616] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.585595] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.588075] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.589016] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.589956] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.593820] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.627007] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.629613] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.629666] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.630756] systemd-journald[94]: Collecting audit messages is disabled. gitlab # [ 1.635338] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.636157] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.636352] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.636357] [drm] features: -context_init gitlab # [ 1.637572] [drm] number of scanouts: 1 gitlab # [ 1.637591] [drm] number of cap sets: 0 gitlab # [ 1.642044] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.642072] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.650362] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.658135] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.673813] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.677554] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.679483] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.680110] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.680537] systemd[1]: Reached target Local File Systems. gitlab # [ 1.687915] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.705753] systemd-modules-load[95]: Using 4 probe threads gitlab # [ 1.714566] systemd[1]: Started Journal Service. gitlab # [ 1.713589] systemd-modules-load[95]: Module 'virtio_balloon' is built in gitlab # [ 1.714971] systemd-modules-load[95]: Module 'virtio_console' is built in gitlab # [ 1.718610] systemd-modules-load[95]: Module 'virtio_rng' is built in gitlab # [ 1.720134] systemd-modules-load[95]: Inserted module 'dm_mod' gitlab # [ 1.721298] systemd-modules-load[95]: Inserted module 'virtio_gpu' gitlab # [ 1.722480] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.736201] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.749442] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.753967] systemd-udevd[107]: Using default interface naming scheme 'v261'. gitlab # [ 1.774199] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.799705] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.872772] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.878372] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.281175] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.283954] systemd[1]: Reached target System Initialization. gitlab # [ 2.286506] systemd[1]: Reached target Basic System. gitlab # [ 2.486554] (udev-worker)[120]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.492797] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.499172] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.534483] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.536573] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.538494] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.557480] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.581222] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.588308] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.589936] systemd[1]: Mounting /sysroot... gitlab # [ 2.631771] EXT4-fs (vda): mounted filesystem ca07a530-f0a6-48fe-849a-9de1558a55a6 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.629323] systemd[1]: Mounted /sysroot. gitlab # [ 2.630603] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.633741] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.639457] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.641936] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.644122] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.660457] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.665670] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.679133] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.684738] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.686262] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.694231] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.697208] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.699528] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.700819] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.704145] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.715293] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.717084] systemd[1]: Reloading... gitlab # [ 2.972160] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.021279] systemd[1]: Reloading finished in 304 ms. gitlab # [ 3.082679] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.084947] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.088204] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace... gitlab # [ 3.092537] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.095612] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.096729] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.097779] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.112838] (udev-worker)[120]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.116340] (udev-worker)[120]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.119872] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.121253] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.127217] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.128682] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.129477] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.130272] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.136040] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.137067] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.140128] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.175317] systemd-vconsole-setup[199]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.178034] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.585331] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.656737] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.659081] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.661659] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.664208] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.711441] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.715291] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.728318] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.730550] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.733115] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.788523] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.791191] systemd[1]: Stopped target Basic System. gitlab # [ 3.793551] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.795967] systemd[1]: Stopped target Path Units. gitlab # [ 3.798175] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.801547] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.804892] systemd[1]: Stopped target Slice Units. gitlab # [ 3.807097] systemd[1]: Stopped target Socket Units. gitlab # [ 3.809383] systemd[1]: Stopped target System Initialization. gitlab # [ 3.815133] systemd[1]: Stopped target Swaps. gitlab # [ 3.817306] systemd[1]: Stopped target Timer Units. gitlab # [ 3.819562] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.822583] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.826699] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.830119] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.832350] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.834989] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.837647] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.840349] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.842308] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.844968] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.846640] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.849267] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.851562] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.853791] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.855629] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.857282] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.859101] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.860978] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.862376] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.864231] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.865962] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.867234] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.868853] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.870528] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.872236] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.873551] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.875170] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.876595] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.878095] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.879688] systemd[1]: systemd-udevd.service: Consumed 2.378s CPU time over 2.173s wall clock time, 31.4M memory peak. gitlab # [ 3.882082] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.883657] systemd[1]: Closed udev Control Socket. gitlab # [ 3.884842] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.886064] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.887762] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.889272] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.891115] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.892787] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.894338] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.974565] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.977942] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.980354] systemd[1]: Reached target Switch Root. gitlab # [ 3.982502] systemd[1]: Starting NixOS Activation... gitlab # [ 4.166856] initrd-nixos-activation-start[226]: booting system configuration /nix/store/qmqxwkz0njs33kfa9f76yvdnszdsbwwf-nixos-system-gitlab-test gitlab # [ 4.228892] initrd-nixos-activation-start[226]: running activation script... gitlab # [ 4.554180] initrd-nixos-activation-start[249]: setting up /etc... gitlab # [ 4.728751] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.732075] systemd[1]: Finished NixOS Activation. gitlab # [ 4.734236] systemd[1]: Starting Switch Root... gitlab # [ 4.786907] systemd[1]: Switching root. gitlab # [ 4.934493] systemd-journald[94]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.546634] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.546775] systemd[1]: Detected virtualization qemu. gitlab # [ 5.546858] systemd[1]: Detected architecture arm64. gitlab # [ 5.547049] systemd[1]: Detected first boot. gitlab # [ 5.548468] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.776627] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.912815] systemd[1]: Applying preset policy. gitlab # [ 6.101350] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.243905] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.244328] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.248617] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.255326] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.259009] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.263135] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.264637] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.265995] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.267115] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.268188] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.269314] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.270516] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.271577] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.272649] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.273633] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.274015] systemd[1]: Reached target Path Units. gitlab # [ 6.274301] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.274559] systemd[1]: Reached target Slice Units. gitlab # [ 6.274812] systemd[1]: Reached target Swaps. gitlab # [ 6.276221] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.277870] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.279190] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.280631] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.281197] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.290063] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.292181] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.296131] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.297422] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.298590] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.299658] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.306227] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.307639] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.309037] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.354130] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.359767] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.366220] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.374559] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.384144] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.393850] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.395013] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.406337] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.408772] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.410552] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.430706] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.431594] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.444075] systemd[1]: Starting Journal Service... gitlab # [ 6.450945] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.457668] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.465669] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.466259] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.484787] fuse: init (API version 7.45) gitlab # [ 6.487585] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.496663] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.497958] systemd-journald[320]: Collecting audit messages is enabled. gitlab # [ 6.498921] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.499739] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.500531] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.501390] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.502641] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.503774] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.521283] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.504818] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.505756] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.506777] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.525868] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 6.507729] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.509008] systemd[1]: Finished Load Kernel Modules. gitlab # gitlab # [ 6.517670] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.527994] systemd[1]: Starting Firewall... gitlab # [ 6.538428] EXT4-fs (vda): re-mounted ca07a530-f0a6-48fe-849a-9de1558a55a6. gitlab # [ 6.537343] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.542388] systemd-modules-load[321]: Using 3 probe threads[ 6.547819] systemd[1]: Starting Apply Kernel Variables... gitlab # gitlab # [ 6.546201] systemd-modules-load[321]: Module 'atkbd' is built in gitlab # [ 6.547506] systemd-modules-load[321]: Module 'loop' is built in gitlab # [ 6.548747] systemd-modules-load[321]: Inserted module 'tls' gitlab # [ 6.562624] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.564857] systemd[1]: Started Journal Service. gitlab # [ 6.563136] systemd-oomd[322]: No swap; memory pressure usage will be degraded gitlab # [ 6.564892] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.566150] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.567979] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.581813] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.586530] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.589945] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.593929] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.598728] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.600380] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.607837] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.616040] systemd-journald[320]: Received client request to flush runtime journal. gitlab # [ 6.632775] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.634502] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.635512] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.636873] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.641068] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.642166] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.644427] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.707981] systemd-udevd[358]: Using default interface naming scheme 'v261'. gitlab # [ 6.741596] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.149264] systemd[1]: Finished Firewall. gitlab # [ 7.183124] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.245562] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.275456] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.281634] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.285302] systemd[1]: Reached target Local File Systems. gitlab # [ 7.288470] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.292978] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.299388] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.301039] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.321782] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.325724] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.383724] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.392123] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.395189] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.408297] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.412460] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.415510] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.417740] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.426726] (udev-worker)[472]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.456189] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.464205] (udev-worker)[390]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.467114] (udev-worker)[390]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.478751] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.483406] systemd[1]: Starting Update is Completed... gitlab # [ 7.486335] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.499571] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.501641] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.503281] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.506134] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.508061] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.509552] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.520815] systemd[1]: Finished Update is Completed. gitlab # [ 7.551120] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.552683] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.553715] systemd[1]: suid-sgid-wrappers.service: Consumed 152ms CPU time over 252ms wall clock time, 6.3M memory peak, 1.9M read from disk. gitlab # [ 7.586128] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.804123] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.805846] systemd[1]: Reached target System Initialization. gitlab # [ 7.808569] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.809647] systemd[1]: Started logrotate.timer. gitlab # [ 7.810391] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.813581] systemd[1]: Reached target Timer Units. gitlab # [ 7.814445] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.815448] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.830952] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.831959] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.834774] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.835787] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.837490] systemd[1]: Reached target Socket Units. gitlab # [ 7.867717] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.869310] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.870711] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.873977] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.884350] dbus-broker-launch[562]: Ready gitlab # [ 7.885153] systemd[1]: Reached target Basic System. gitlab # [ 7.886711] systemd[1]: Started backdoor.service. gitlab # [ 7.889906] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.894509] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.908334] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.913992] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.919557] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.930896] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.933816] logrotate[567]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.935949] logrotate[567]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # connecting to host... gitlab # [ 7.941168] logrotate[567]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.942459] logrotate[567]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.943436] logrotate[567]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.948130] logrotate[567]: Allocating hash table for state file, size 64 entries gitlab # [ 7.949249] logrotate[567]: Handling 4 logs gitlab # [ 7.949901] logrotate[567]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.952280] logrotate[567]: considering log /var/log/btmp gitlab # [ 7.953020] logrotate[567]: Creating new state gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.953642] logrotate[567]: Now: 2026-08-23 16:52 gitlab # [ 7.954349] logrotate[567]: Last rotated at 2026-08-23 16:00 gitlab: connected to guest root shell gitlab # [ 7.955105] logrotate[567]: log does not need rotating (log has already been rotated) gitlab: (connecting took 8.40 seconds) gitlab # [ 7.958993] logrotate[567]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab: (finished: waiting for the VM to finish booting, in 8.40 seconds) gitlab # [ 7.961122] logrotate[567]: considering log /var/log/wtmp gitlab # [ 7.961803] logrotate[567]: Creating new state gitlab # [ 7.962372] logrotate[567]: Now: 2026-08-23 16:52 gitlab # [ 7.962987] logrotate[567]: Last rotated at 2026-08-23 16:00 gitlab # [ 7.963816] logrotate[567]: log does not need rotating (log has already been rotated) gitlab # [ 7.968488] logrotate[567]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.970262] logrotate[567]: switching euid from 0 to 165 and egid from 0 to 165 (pid 567) gitlab # [ 7.971562] logrotate[567]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.973184] logrotate[567]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.974286] logrotate[567]: Creating new state gitlab # [ 7.974905] logrotate[567]: switching euid from 165 to 0 and egid from 165 to 0 (pid 567) gitlab # [ 7.975984] logrotate[567]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.977850] logrotate[567]: switching euid from 0 to 60 and egid from 0 to 60 (pid 567) gitlab # [ 7.978911] logrotate[567]: considering log /var/log/nginx/*.log gitlab # [ 7.979733] logrotate[567]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.980918] logrotate[567]: Creating new state gitlab # [ 7.981535] logrotate[567]: not running postrotate script, since no logs were rotated gitlab # [ 7.982555] logrotate[567]: switching euid from 60 to 0 and egid from 60 to 0 (pid 567) gitlab # [ 7.983766] systemd[1]: Starting resolvconf update... gitlab # [ 7.985037] nsncd[568]: Aug 23 16:52:02.839 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.987877] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.989398] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.990453] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.992595] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.993732] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.994616] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.995496] systemd[1]: Starting User Login Management... gitlab # [ 8.058170] systemd-logind[606]: New seat seat0. gitlab # [ 8.061926] systemd-logind[606]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.063250] systemd-logind[606]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.064926] systemd[1]: Started User Login Management. gitlab # [ 8.071053] systemd[1]: Starting linger-users.service... gitlab # [ 8.077555] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.078536] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.079411] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.082499] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.083348] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.088098] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.089129] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.090000] systemd[1]: nscd.service: Consumed 23ms CPU time over 173ms wall clock time, 7.6M memory peak, 5.8M read from disk. gitlab # [ 8.100342] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.102733] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.104654] systemd[1]: Finished linger-users.service. gitlab # [ 8.119050] nsncd[663]: Aug 23 16:52:03.004 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.121576] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.122503] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.123449] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.157777] systemd[1]: Finished resolvconf update. gitlab # [ 8.158563] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.164359] systemd[1]: Starting DHCP Client... gitlab # [ 8.167548] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.170398] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.189578] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 8.216347] network-addresses-eth1-start[687]: adding address 192.168.1.1/24... done gitlab # [ 8.222204] network-addresses-eth1-start[687]: adding address 2001:db8:1::1/64... done gitlab # [ 8.232159] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.267389] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.269865] dhcpcd[696]: dhcpcd-10.3.2 starting gitlab # [ 8.275798] dhcpcd[730]: dev: loaded udev gitlab # [ 8.286357] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 8.288442] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 8.298068] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.298453] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.294842] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.333143] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.334532] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.340159] systemd[1]: Reached target Network. gitlab # [ 8.344750] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.350570] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.361880] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.360260] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.361557] systemd-logind[606]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.369177] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.369859] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.371740] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.372066] cfg80211: failed to load regulatory.db gitlab # [ 8.373134] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.377821] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.389747] systemd-vconsole-setup[739]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.400400] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.407092] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.405096] dhcpcd[730]: eth0: waiting for carrier gitlab # [ 8.405951] dhcpcd[730]: eth0: carrier acquired gitlab # [ 8.409459] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.412769] dhcpcd[730]: DUID 00:01:00:01:32:1d:e1:b3:52:54:00:12:34:56 gitlab # [ 8.413866] dhcpcd[730]: eth0: IAID 00:12:34:56 gitlab # [ 8.414541] dhcpcd[730]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.423256] systemd[1]: Started Getty on tty1. gitlab # [ 8.424000] systemd[1]: Reached target Login Prompts. gitlab # [ 8.510004] nginx-pre-start[795]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.512174] nginx-pre-start[795]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.514778] systemd[1]: Started Nginx Web Server. gitlab # [ 8.548175] redis-server[794]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.550776] redis-server[794]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.552097] redis-server[794]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=794, just started gitlab # [ 8.553822] redis-server[794]: Configuration loaded gitlab # [ 8.554770] redis[794]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.556164] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.557069] redis[794]: Running mode=standalone, port=0. gitlab # [ 8.558084] redis[794]: Server initialized gitlab # [ 8.558909] redis[794]: Ready to accept connections unix gitlab # [ 8.559835] redis[794]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.582381] postgresql-pre-start[798]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.584543] postgresql-pre-start[798]: This user must also own the server process. gitlab # [ 8.585730] postgresql-pre-start[798]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.587039] postgresql-pre-start[798]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.588294] postgresql-pre-start[798]: The default text search configuration will be set to "english". gitlab # [ 8.589546] postgresql-pre-start[798]: Data page checksums are enabled. gitlab # [ 8.590446] postgresql-pre-start[798]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.591765] postgresql-pre-start[798]: creating subdirectories ... ok gitlab # [ 8.592683] postgresql-pre-start[798]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.627462] postgresql-pre-start[798]: selecting default "max_connections" ... 100 gitlab # [ 8.690778] postgresql-pre-start[798]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.972256] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.223264] gitlab-workhorse[820]: time="2026-08-23T16:52:04Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.228939] gitlab-workhorse[820]: time="2026-08-23T16:52:04Z" level=info msg="Using redis/go-redis" gitlab # [ 9.233906] gitlab-workhorse[820]: time="2026-08-23T16:52:04Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.243604] postgresql-pre-start[798]: selecting default time zone ... UTC gitlab # [ 9.247038] postgresql-pre-start[798]: creating configuration files ... ok gitlab # [ 9.462431] postgresql-pre-start[798]: running bootstrap script ... ok gitlab # [ 9.613715] dhcpcd[730]: eth0: soliciting a DHCP lease gitlab # [ 9.625165] dhcpcd[730]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.648718] dhcpcd[730]: eth0: probing address 10.0.2.15/24 gitlab # [ 10.028327] dhcpcd[730]: eth0: soliciting an IPv6 router gitlab # [ 10.029545] dhcpcd[730]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.030599] dhcpcd[730]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.031668] dhcpcd[730]: eth0: adding route to fec0::/64 gitlab # [ 10.032628] dhcpcd[730]: eth0: adding default route via fe80::2 gitlab # [ 10.285401] postgresql-pre-start[798]: performing post-bootstrap initialization ... ok gitlab # [ 10.591299] postgresql-pre-start[798]: syncing data to disk ... ok gitlab # [ 10.594371] postgresql-pre-start[798]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.598664] postgresql-pre-start[798]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.605628] postgresql-pre-start[798]: Success. You can now start the database server using: gitlab # [ 10.609467] postgresql-pre-start[798]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.775064] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.779950] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.783391] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.787039] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.799425] postgres[863]: [863] LOG: database system was shut down at 2026-08-23 16:52:05 GMT gitlab # [ 10.813212] postgres[854]: [854] LOG: database system is ready to accept connections gitlab # [ 10.821123] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.828503] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 11.224410] postgresql-setup-start[874]: CREATE DATABASE gitlab # [ 11.263630] postgresql-setup-start[888]: CREATE ROLE gitlab # [ 11.284711] postgresql-setup-start[895]: ALTER DATABASE gitlab # [ 11.314236] postgresql-setup-start[900]: CREATE ROLE gitlab # [ 11.316810] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 11.318524] systemd[1]: Reached target PostgreSQL. gitlab # [ 11.322160] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.354709] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 11.359136] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 11.439435] systemd[1]: Finished gitlab-config.service. gitlab # [ 11.450997] systemd[1]: Started gitaly.service. gitlab # [ 11.454387] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.492209] gitlab-postgresql-start[914]: CREATE DATABASE gitlab # [ 11.558590] gitlab-postgresql-start[933]: CREATE EXTENSION gitlab # [ 11.679684] gitlab-postgresql-start[935]: CREATE EXTENSION gitlab # [ 11.685752] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 12.478939] gitaly[924]: time="2026-08-23T16:52:07.363Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=924 gitlab # [ 12.488440] gitaly[924]: time="2026-08-23T16:52:07.364Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=924 gitlab # [ 12.498913] gitaly[924]: time="2026-08-23T16:52:07.364Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=924 gitlab # [ 12.501727] gitaly[924]: time="2026-08-23T16:52:07.364Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=924 gitlab # [ 12.503663] gitaly[924]: time="2026-08-23T16:52:07.364Z" level=info msg="Starting Gitaly" pid=924 version= gitlab # [ 12.767078] gitaly[924]: time="2026-08-23T16:52:07.651Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=285 pid=924 gitlab # [ 12.769670] gitaly[924]: time="2026-08-23T16:52:07.651Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=924 gitlab # [ 12.771696] gitaly[924]: time="2026-08-23T16:52:07.652Z" level=info msg="finished initializing command factory" duration_ms=0 pid=924 gitlab # [ 12.774033] gitaly[924]: time="2026-08-23T16:52:07.652Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-924/git-exec-2699657758.d/git pid=924 gitlab # [ 12.776557] gitaly[924]: time="2026-08-23T16:52:07.658Z" level=info msg="finished detecting git version" duration_ms=5 pid=924 gitlab # [ 12.778611] gitaly[924]: time="2026-08-23T16:52:07.658Z" level=info msg="using Git version" pid=924 version=2.53.g gitlab # [ 12.780465] gitaly[924]: time="2026-08-23T16:52:07.658Z" level=info msg="clearing disk cache object folder" pid=924 storage=default gitlab # [ 12.782571] gitaly[924]: time="2026-08-23T16:52:07.659Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3489881939 pid=924 storage=default gitlab # [ 12.785871] gitaly[924]: time="2026-08-23T16:52:07.659Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3489881939 pid=924 storage=default gitlab # [ 12.789932] gitaly[924]: time="2026-08-23T16:52:07.659Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=924 gitlab # [ 12.793798] gitaly[924]: time="2026-08-23T16:52:07.659Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=924 gitlab # [ 12.797238] gitaly[924]: time="2026-08-23T16:52:07.659Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3489881939 clear_duration_ms=0 pid=924 storage=default gitlab # [ 12.800747] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="counting repositories" pid=924 gitlab # [ 12.802571] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="starting to count repositories" pid=924 storage_path=/var/gitlab/state/repositories gitlab # [ 12.805131] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=924 storage_path=/var/gitlab/state/repositories gitlab # [ 12.808174] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="completed counting all repositories" counting_duration=0 pid=924 gitlab # [ 12.810487] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="finished tempdir cleaner walk" pid=924 storage=default time_ms=0 gitlab # [ 12.812906] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=924 gitlab # [ 12.815688] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=924 schema=unix gitlab # [ 12.818751] gitaly[924]: time="2026-08-23T16:52:07.679Z" level=info msg="listening at address" address=/run/gitaly/gitaly-924/sock.d/intern pid=924 schema=unix gitlab # [ 12.821347] gitaly[924]: time="2026-08-23T16:52:07.682Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=924 gitlab # [ 12.823571] gitaly[924]: time="2026-08-23T16:52:07.682Z" level=info msg="Started Gitaly" duration_ms=317 pid=924 gitlab # [ 12.825743] gitaly[924]: time="2026-08-23T16:52:07.682Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=924 gitlab # [ 12.827959] gitaly[924]: time="2026-08-23T16:52:07.682Z" level=info msg="maintenance: daily scheduled" pid=924 scheduled="2026-08-24 12:00:00 +0000 UTC" gitlab # [ 13.185368] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.194570] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.211379] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 14.721245] dhcpcd[730]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 14.721702] dhcpcd[730]: eth0: adding route to 10.0.2.0/24 gitlab # [ 14.721820] dhcpcd[730]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.977214] systemd[1]: Started DHCP Client. gitlab # [ 14.981957] systemd[1]: Reached target Network is Online. gitlab # [ 16.769055] gitaly[924]: time="2026-08-23T16:52:11.653Z" level=info msg="License database preloaded" duration_ms=4288 pid=924 gitlab # [ 59.297189] gitlab-workhorse[820]: time="2026-08-23T16:52:54Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 59.582214] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: W, [2026-08-23T16:52:54.466660 #931] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 62.574741] postgres[1447]: [1447] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 62.575156] postgres[1447]: [1447] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 62.575281] postgres[1447]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 62.575398] postgres[1447]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 62.575511] postgres[1447]: attidentity AS identity, gitlab # [ 62.575624] postgres[1447]: attgenerated as attgenerated gitlab # [ 62.575738] postgres[1447]: FROM pg_attribute a gitlab # [ 62.575852] postgres[1447]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 62.575985] postgres[1447]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 62.602277] postgres[1447]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 62.606544] postgres[1447]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 62.609331] postgres[1447]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 62.611748] postgres[1447]: ORDER BY a.attnum gitlab # [ 62.613554] postgres[1447]: gitlab # [ 67.764086] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1498]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 67.764462] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1498]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.306382] gitlab-workhorse[820]: time="2026-08-23T16:53:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.308247] gitlab-workhorse[820]: time="2026-08-23T16:53:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.309750] gitlab-workhorse[820]: time="2026-08-23T16:53:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 94.690489] postgres[1601]: [1601] ERROR: relation "table_without_models" does not exist gitlab # [ 94.691000] postgres[1601]: [1601] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.318022] gitlab-workhorse[820]: time="2026-08-23T16:53:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.326853] gitlab-workhorse[820]: time="2026-08-23T16:53:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.337162] gitlab-workhorse[820]: time="2026-08-23T16:53:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 127.944960] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 127.951915] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 127.958217] systemd[1]: Starting gitlab.service... gitlab # [ 128.542369] bundle[2012]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 128.549060] bundle[2012]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 128.555150] bundle[2012]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 129.338299] gitlab-workhorse[820]: time="2026-08-23T16:54:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 135.412858] sidekiq-cluster[2011]: {"severity":"INFO","time":"2026-08-23T16:54:10.247Z","message":"Starting cluster with 1 processes"} gitlab # [ 135.970796] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.804Z","pid":2012,"message":"* Enabling systemd notification integration"} gitlab # [ 135.976334] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"Puma starting in cluster mode..."} gitlab # [ 135.980978] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 135.986036] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 135.992162] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Min threads: 0"} gitlab # [ 135.996139] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Max threads: 4"} gitlab # [ 135.999958] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Environment: production"} gitlab # [ 136.003711] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Master PID: 2012"} gitlab # [ 136.007318] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Workers: 2"} gitlab # [ 136.010633] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 136.014485] bundle[2012]: {"timestamp":"2026-08-23T16:54:10.855Z","pid":2012,"message":"* Preloading application"} gitlab # [ 139.342918] gitlab-workhorse[820]: time="2026-08-23T16:54:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.346107] gitlab-workhorse[820]: time="2026-08-23T16:54:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.357347] gitlab-workhorse[820]: time="2026-08-23T16:54:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 169.362949] gitlab-workhorse[820]: time="2026-08-23T16:54:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 179.370646] gitlab-workhorse[820]: time="2026-08-23T16:54:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.381067] gitlab-workhorse[820]: time="2026-08-23T16:55:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.820893] bundle[2012]: W, [2026-08-23T16:55:04.705099 #2012] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 198.934761] sidekiq-cluster[2080]: 2026-08-23T16:55:13.819Z pid=2080 tid=xt8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2080, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425693184} gitlab # [ 199.279226] sidekiq-cluster[2080]: W, [2026-08-23T16:55:14.164551 #2080] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 199.390578] gitlab-workhorse[820]: time="2026-08-23T16:55:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.450892] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:14.336Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 203.122026] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.006Z","message":"GitLab reliable fetch activated!"} gitlab # [ 203.122457] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.006Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 203.159476] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.045Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 203.166962] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.048Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 203.174352] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.051Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 203.181210] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.054Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 203.188844] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.057Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 203.195580] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.059Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 203.201819] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.062Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 203.207164] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.064Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 203.212257] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.066Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 203.220324] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.068Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 203.226022] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.070Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 203.235599] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.073Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 203.240989] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.076Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 203.246442] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.078Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 203.252765] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.080Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 203.257631] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.082Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 203.262373] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.086Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 203.266929] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.089Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 203.271711] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.092Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 203.276126] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.095Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 203.284182] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.098Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 203.288539] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.101Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 203.292047] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.104Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 203.295403] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.106Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 203.300629] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.109Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 203.307415] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.112Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 203.314599] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.115Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 203.321281] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.118Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 203.327791] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.122Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 203.333821] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.125Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 203.338713] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.128Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 203.343886] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.131Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 203.348295] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.134Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 203.352444] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.137Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 203.356332] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.141Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 203.359936] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.144Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 203.363672] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.148Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 203.367512] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.151Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 203.370990] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.153Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 203.374158] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.155Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 203.377336] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.158Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 203.380330] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.160Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 203.383288] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.163Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 203.386270] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.165Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 203.389288] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.169Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 203.392263] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.171Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 203.395059] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.173Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 203.398136] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.175Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 203.400551] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.178Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 203.402896] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.181Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 203.405377] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.183Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 203.407627] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.186Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 203.410069] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.200Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 203.412496] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.203Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 203.414623] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.206Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 203.416720] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.209Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 203.418869] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.211Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 203.421297] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.295Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 203.423553] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.300Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 203.426002] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.302Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 203.428079] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.305Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 203.430161] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.308Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 203.432379] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.311Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 203.436077] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.315Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 203.438543] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.319Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 203.440986] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.322Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 203.443271] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.326Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 203.445763] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.328Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 203.448273] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.330Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 203.450789] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.333Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 203.453410] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.335Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 203.455883] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.339Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 203.458680] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.341Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 203.461541] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.344Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 203.464264] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.346Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 203.466998] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.350Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 203.469693] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.352Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 203.472545] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.354Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 203.474912] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.357Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 203.477337] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.359Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 203.479868] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.362Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 203.482732] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.364Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 203.485344] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.368Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 203.487547] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.369Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 203.490437] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.372Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 203.493052] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.374Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 203.495628] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.377Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 203.498290] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.379Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 203.500889] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.381Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 203.503328] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.383Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 203.505916] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.384Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 203.508308] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.387Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 203.510686] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.389Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 203.513342] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.392Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 203.515457] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.394Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 203.518090] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.400Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 203.520485] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.401Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 203.522842] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.403Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 203.531506] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.417Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 203.534785] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.420Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 203.537134] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.422Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 203.540802] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.426Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 203.543718] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.429Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 203.547203] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.432Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 203.550794] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.436Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 203.554948] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.440Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 203.558009] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.443Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 203.565097] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.450Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 203.569626] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:55:18.455Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 209.392157] gitlab-workhorse[820]: time="2026-08-23T16:55:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 219.404551] gitlab-workhorse[820]: time="2026-08-23T16:55:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 229.417009] gitlab-workhorse[820]: time="2026-08-23T16:55:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 239.426612] gitlab-workhorse[820]: time="2026-08-23T16:55:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 249.429227] gitlab-workhorse[820]: time="2026-08-23T16:56:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 253.090456] postgres[3048]: [3048] ERROR: relation "table_without_models" does not exist gitlab # [ 253.090891] postgres[3048]: [3048] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 254.677608] postgres[3068]: [3068] ERROR: relation "table_without_models" does not exist gitlab # [ 254.679448] postgres[3068]: [3068] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 258.937829] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:13.822Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 258.940069] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:13.822Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 258.942190] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:13.822Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 258.948108] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:13.822Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 258.950499] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:13.832Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 259.431400] gitlab-workhorse[820]: time="2026-08-23T16:56:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 262.629905] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:17.514Z","message":"Cleaning working queues"} gitlab # [ 262.632499] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:17.517Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ca8d0030cb09277ba4874253","created_at":"2026-08-23T16:54:02.271Z","trace_propagation_headers":{"sentry-trace":"974ec0ad2c274a19ade035926bec9692-03028b1a437d414a","baggage":"sentry-trace_id=974ec0ad2c274a19ade035926bec9692,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6bbc3454736ee7dc1295dd888b3c8ec2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:02.284Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ca8d0030cb09277ba4874253: start","job_status":"start","queue_duration_s":135.232812,"scheduling_latency_s":135.232932} gitlab # [ 263.074594] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:17.959Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ca8d0030cb09277ba4874253","created_at":"2026-08-23T16:54:02.271Z","trace_propagation_headers":{"sentry-trace":"974ec0ad2c274a19ade035926bec9692-03028b1a437d414a","baggage":"sentry-trace_id=974ec0ad2c274a19ade035926bec9692,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6bbc3454736ee7dc1295dd888b3c8ec2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:54:02.284Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ca8d0030cb09277ba4874253: done: 0.442168 sec","job_status":"done","queue_duration_s":135.232812,"scheduling_latency_s":135.232932,"redis_calls":29,"redis_duration_s":0.014353,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.008796,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003391,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002166,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.224804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2307288,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.442168,"completed_at":"2026-08-23T16:56:17.958Z","load_balancing_strategy":"primary","db_duration_s":0.12824,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 263.273073] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.157Z","pid":2012,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 263.278824] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.157Z","pid":2012,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 263.284099] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.157Z","pid":2012,"message":"! #\u003cThread:0x0000f337b4dfaa68 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 263.299759] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.157Z","pid":2012,"message":"! #\u003cThread:0x0000f337b474c518 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 263.314819] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.158Z","pid":2012,"message":"Use Ctrl-C to stop"} gitlab # [ 263.318084] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.158Z","pid":2012,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 264.076863] bundle[2012]: {"timestamp":"2026-08-23T16:56:18.962Z","pid":2012,"message":"- Worker 0 (PID: 3204) booted in 0.76s, phase: 0"} gitlab # [ 264.121878] bundle[2012]: {"timestamp":"2026-08-23T16:56:19.006Z","pid":2012,"message":"- Worker 1 (PID: 3208) booted in 0.77s, phase: 0"} gitlab # [ 264.128196] systemd[1]: Started gitlab.service. gitlab # [ 264.130551] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 264.133690] systemd[1]: Starting setup-gitlab.service... gitlab # [ 264.170708] setup-gitlab-start[3241]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 268.870635] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:56:23 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 4647 gitlab # [ 268.875374] setup-gitlab-start[3241]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 268.876646] setup-gitlab-start[3241]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 268.897708] runuser[3268]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 269.607956] setup-gitlab-start[3269]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 269.608671] setup-gitlab-start[3269]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 269.610984] setup-gitlab-start[3269]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 270.726319] setup-gitlab-start[3269]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 270.726784] setup-gitlab-start[3269]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 270.729997] setup-gitlab-start[3269]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 276.158507] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e2cb0c51ce009e26c9d3d024","created_at":"2026-08-23T16:56:30.924Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6bee96e5d54f1dbe79ff2038d9bdadec","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.038Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e2cb0c51ce009e26c9d3d024: start","job_status":"start","queue_duration_s":0.003765,"scheduling_latency_s":0.003817} gitlab # [ 276.452936] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.337Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e2cb0c51ce009e26c9d3d024","created_at":"2026-08-23T16:56:30.924Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6bee96e5d54f1dbe79ff2038d9bdadec","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.038Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e2cb0c51ce009e26c9d3d024: done: 0.294752 sec","job_status":"done","queue_duration_s":0.003765,"scheduling_latency_s":0.003817,"redis_calls":12,"redis_duration_s":0.037785,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.009859,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003683,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005587,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0029313,"duration_s":0.294752,"completed_at":"2026-08-23T16:56:31.336Z","load_balancing_strategy":"primary","db_duration_s":0.034888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.565675] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"29e6c2d3a17ebcbe06b03e6a","created_at":"2026-08-23T16:56:31.071Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c77f13dec0d66538083d4869541e4ae4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.091Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-29e6c2d3a17ebcbe06b03e6a: start","job_status":"start","queue_duration_s":0.252607,"scheduling_latency_s":0.252672} gitlab # [ 276.586620] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"29e6c2d3a17ebcbe06b03e6a","created_at":"2026-08-23T16:56:31.071Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c77f13dec0d66538083d4869541e4ae4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.091Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-29e6c2d3a17ebcbe06b03e6a: done: 0.079353 sec","job_status":"done","queue_duration_s":0.252607,"scheduling_latency_s":0.252672,"redis_calls":12,"redis_duration_s":0.005448,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00204,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006584,"duration_s":0.079353,"completed_at":"2026-08-23T16:56:31.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.637117] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"543420d202f0b0be17cb5ae1","created_at":"2026-08-23T16:56:31.127Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"329085a4bec1107199eb7b732d34964e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.163Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-543420d202f0b0be17cb5ae1: start","job_status":"start","queue_duration_s":0.264545,"scheduling_latency_s":0.264598} gitlab # [ 276.703302] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"543420d202f0b0be17cb5ae1","created_at":"2026-08-23T16:56:31.127Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"329085a4bec1107199eb7b732d34964e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.163Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-543420d202f0b0be17cb5ae1: done: 0.159158 sec","job_status":"done","queue_duration_s":0.264545,"scheduling_latency_s":0.264598,"redis_calls":10,"redis_duration_s":0.019163,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009163,"duration_s":0.159158,"completed_at":"2026-08-23T16:56:31.587Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 276.772239] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3025c839e4fbeacf8ca3dc6f","created_at":"2026-08-23T16:56:31.183Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0be20a884a3b34dc14791412abe10843","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.200Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3025c839e4fbeacf8ca3dc6f: start","job_status":"start","queue_duration_s":0.410518,"scheduling_latency_s":0.41059} gitlab # [ 277.016005] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3025c839e4fbeacf8ca3dc6f","created_at":"2026-08-23T16:56:31.183Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0be20a884a3b34dc14791412abe10843","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.200Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3025c839e4fbeacf8ca3dc6f: done: 0.289629 sec","job_status":"done","queue_duration_s":0.410518,"scheduling_latency_s":0.41059,"redis_calls":10,"redis_duration_s":0.025779,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00350762,"duration_s":0.289629,"completed_at":"2026-08-23T16:56:31.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.108341] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:31.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2f2312afc90f04878793f4a5","created_at":"2026-08-23T16:56:31.222Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.240Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2f2312afc90f04878793f4a5: start","job_status":"start","queue_duration_s":0.692052,"scheduling_latency_s":0.692119} gitlab # [ 277.340136] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2f2312afc90f04878793f4a5","created_at":"2026-08-23T16:56:31.222Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.240Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2f2312afc90f04878793f4a5: done: 0.290181 sec","job_status":"done","queue_duration_s":0.692052,"scheduling_latency_s":0.692119,"redis_calls":19,"redis_duration_s":0.075006,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008652,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.004674,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.039138,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.022542,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00375752,"duration_s":0.290181,"completed_at":"2026-08-23T16:56:32.222Z","load_balancing_strategy":"primary","db_duration_s":0.02547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.421091] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"583493e2cd6758a7458d79e0","created_at":"2026-08-23T16:56:31.265Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd9e1dfec1a8e4238d8bd2a28ddc31de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.290Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-583493e2cd6758a7458d79e0: start","job_status":"start","queue_duration_s":0.948042,"scheduling_latency_s":0.948113} gitlab # [ 277.437491] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.320Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 277.488241] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"583493e2cd6758a7458d79e0","created_at":"2026-08-23T16:56:31.265Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd9e1dfec1a8e4238d8bd2a28ddc31de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.290Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-583493e2cd6758a7458d79e0: done: 0.13378 sec","job_status":"done","queue_duration_s":0.948042,"scheduling_latency_s":0.948113,"redis_calls":10,"redis_duration_s":0.037406,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004817,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.027556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00481288,"duration_s":0.13378,"completed_at":"2026-08-23T16:56:32.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.568912] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ac368009fea3237e268c68d0","created_at":"2026-08-23T16:56:31.323Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"441f4aaa3941942207224568a19aea2c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.419Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ac368009fea3237e268c68d0: start","job_status":"start","queue_duration_s":0.970786,"scheduling_latency_s":0.970864} gitlab # [ 277.742519] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ac368009fea3237e268c68d0","created_at":"2026-08-23T16:56:31.323Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"441f4aaa3941942207224568a19aea2c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.419Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ac368009fea3237e268c68d0: done: 0.234408 sec","job_status":"done","queue_duration_s":0.970786,"scheduling_latency_s":0.970864,"redis_calls":13,"redis_duration_s":0.087429,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.012939,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.061559,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.012931,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0334691,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.234408,"completed_at":"2026-08-23T16:56:32.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024012,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 277.829139] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1e9b846710700d50fd524a8a","created_at":"2026-08-23T16:56:31.441Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae7361d6ecc229fbd14f546765c481b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:56:31.477Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1e9b846710700d50fd524a8a: start","job_status":"start","queue_duration_s":1.169157,"scheduling_latency_s":1.169219} gitlab # [ 277.845360] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.714Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 277.858234] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"1e9b846710700d50fd524a8a","created_at":"2026-08-23T16:56:31.441Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae7361d6ecc229fbd14f546765c481b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:56:31.477Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-1e9b846710700d50fd524a8a: done: 0.096313 sec","job_status":"done","queue_duration_s":1.169157,"scheduling_latency_s":1.169219,"redis_calls":10,"redis_duration_s":0.007594,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000875,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0014251,"duration_s":0.096313,"completed_at":"2026-08-23T16:56:32.742Z","load_balancing_strategy":"primary","db_duration_s":0.006169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.918673] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d4f130754b87000d33c3b08c","created_at":"2026-08-23T16:56:31.534Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c8ec3b63d0ac6da1c69ddb252e410cb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.577Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d4f130754b87000d33c3b08c: start","job_status":"start","queue_duration_s":1.181385,"scheduling_latency_s":1.181462} gitlab # [ 277.936781] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d4f130754b87000d33c3b08c","created_at":"2026-08-23T16:56:31.534Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c8ec3b63d0ac6da1c69ddb252e410cb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.577Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d4f130754b87000d33c3b08c: done: 0.063156 sec","job_status":"done","queue_duration_s":1.181385,"scheduling_latency_s":1.181462,"redis_calls":10,"redis_duration_s":0.003924,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000879,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005781,"duration_s":0.063156,"completed_at":"2026-08-23T16:56:32.821Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 277.987790] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.824Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"e92f696623267f006cd87cc3","created_at":"2026-08-23T16:56:31.596Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ba44478b31296301e2146afed8959fc3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.621Z","job_size_bytes":3,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-e92f696623267f006cd87cc3: start","job_status":"start","queue_duration_s":1.203229,"scheduling_latency_s":1.203276} gitlab # [ 278.002746] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.863Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"e92f696623267f006cd87cc3","created_at":"2026-08-23T16:56:31.596Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ba44478b31296301e2146afed8959fc3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.621Z","job_size_bytes":3,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-e92f696623267f006cd87cc3: done: 0.039402 sec","job_status":"done","queue_duration_s":1.203229,"scheduling_latency_s":1.203276,"redis_calls":10,"redis_duration_s":0.003012,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00067,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047092,"duration_s":0.039402,"completed_at":"2026-08-23T16:56:32.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.047967] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ea603787bc65bc4712e4c733","created_at":"2026-08-23T16:56:31.638Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0aa4205a90762e82a549dc51e3f2abef","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.654Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ea603787bc65bc4712e4c733: start","job_status":"start","queue_duration_s":1.212216,"scheduling_latency_s":1.212256} gitlab # [ 278.062883] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ea603787bc65bc4712e4c733","created_at":"2026-08-23T16:56:31.638Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0aa4205a90762e82a549dc51e3f2abef","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.654Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ea603787bc65bc4712e4c733: done: 0.058001 sec","job_status":"done","queue_duration_s":1.212216,"scheduling_latency_s":1.212256,"redis_calls":10,"redis_duration_s":0.003274,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066504,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.058001,"completed_at":"2026-08-23T16:56:32.924Z","load_balancing_strategy":"primary","db_duration_s":0.013018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.109575] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:32.928Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4ed79010655fb0ef1e39cd79","created_at":"2026-08-23T16:56:31.671Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c150c1c11af7bf88cffbdeefc82d9483","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.684Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4ed79010655fb0ef1e39cd79: start","job_status":"start","queue_duration_s":1.244166,"scheduling_latency_s":1.244223} gitlab # [ 278.159010] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4ed79010655fb0ef1e39cd79","created_at":"2026-08-23T16:56:31.671Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c150c1c11af7bf88cffbdeefc82d9483","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.684Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4ed79010655fb0ef1e39cd79: done: 0.11438 sec","job_status":"done","queue_duration_s":1.244166,"scheduling_latency_s":1.244223,"redis_calls":16,"redis_duration_s":0.009247,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004745,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089494,"duration_s":0.11438,"completed_at":"2026-08-23T16:56:33.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024205,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.205039] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c2daeba379c2f6966b4e31de","created_at":"2026-08-23T16:56:31.715Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0e868ffa9cbdf4a0808a370b09da816","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.726Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c2daeba379c2f6966b4e31de: start","job_status":"start","queue_duration_s":1.320186,"scheduling_latency_s":1.320234} gitlab # [ 278.225541] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c2daeba379c2f6966b4e31de","created_at":"2026-08-23T16:56:31.715Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0e868ffa9cbdf4a0808a370b09da816","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.726Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c2daeba379c2f6966b4e31de: done: 0.063341 sec","job_status":"done","queue_duration_s":1.320186,"scheduling_latency_s":1.320234,"redis_calls":12,"redis_duration_s":0.005161,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000815,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002333,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00110812,"exclusive_lock_hold_duration_s":0.01747208,"duration_s":0.063341,"completed_at":"2026-08-23T16:56:33.110Z","load_balancing_strategy":"primary","db_duration_s":0.007702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.267912] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.113Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fcc8c4aad3e6aadda32b4685","created_at":"2026-08-23T16:56:31.759Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12b3916fa789e505718dffa14159a8ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.785Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fcc8c4aad3e6aadda32b4685: start","job_status":"start","queue_duration_s":1.328435,"scheduling_latency_s":1.328481} gitlab # [ 278.283129] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.140Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 278.287123] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fcc8c4aad3e6aadda32b4685","created_at":"2026-08-23T16:56:31.759Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12b3916fa789e505718dffa14159a8ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.785Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fcc8c4aad3e6aadda32b4685: done: 0.042274 sec","job_status":"done","queue_duration_s":1.328435,"scheduling_latency_s":1.328481,"redis_calls":10,"redis_duration_s":0.004411,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000906,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058174,"duration_s":0.042274,"completed_at":"2026-08-23T16:56:33.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.330964] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ba3823cfbc17a16f55617804","created_at":"2026-08-23T16:56:31.859Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96d3adad11548caf49b0d597eb188dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.893Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ba3823cfbc17a16f55617804: start","job_status":"start","queue_duration_s":1.265204,"scheduling_latency_s":1.265247} gitlab # [ 278.346577] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.181Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 278.350152] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ba3823cfbc17a16f55617804","created_at":"2026-08-23T16:56:31.859Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96d3adad11548caf49b0d597eb188dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.893Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ba3823cfbc17a16f55617804: done: 0.035465 sec","job_status":"done","queue_duration_s":1.265204,"scheduling_latency_s":1.265247,"redis_calls":10,"redis_duration_s":0.0033870000000000003,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000777,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049568,"duration_s":0.035465,"completed_at":"2026-08-23T16:56:33.194Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.395801] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"a5279d9ae41f45275e734a97","created_at":"2026-08-23T16:56:31.930Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46eee98e684d70bcb1943794bffcac18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.953Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-a5279d9ae41f45275e734a97: start","job_status":"start","queue_duration_s":1.243591,"scheduling_latency_s":1.243632} gitlab # [ 278.606413] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"a5279d9ae41f45275e734a97","created_at":"2026-08-23T16:56:31.930Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46eee98e684d70bcb1943794bffcac18","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.953Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-a5279d9ae41f45275e734a97: done: 0.293637 sec","job_status":"done","queue_duration_s":1.243591,"scheduling_latency_s":1.243632,"redis_calls":12,"redis_duration_s":0.005296,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002466,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.261632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007477,"exclusive_lock_hold_duration_s":0.25511535999999996,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.293637,"completed_at":"2026-08-23T16:56:33.490Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019529,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 278.705895] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.495Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"bb79e0d7cbadecb2b292c96a","created_at":"2026-08-23T16:56:31.964Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79fa7cf4e2e2b06e4529ce426815be65","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.994Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-bb79e0d7cbadecb2b292c96a: start","job_status":"start","queue_duration_s":1.500939,"scheduling_latency_s":1.500982} gitlab # [ 278.723760] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"bb79e0d7cbadecb2b292c96a","created_at":"2026-08-23T16:56:31.964Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79fa7cf4e2e2b06e4529ce426815be65","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:31.994Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-bb79e0d7cbadecb2b292c96a: done: 0.062491 sec","job_status":"done","queue_duration_s":1.500939,"scheduling_latency_s":1.500982,"redis_calls":12,"redis_duration_s":0.006409,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00113,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00242,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00188358,"exclusive_lock_hold_duration_s":0.008855680000000001,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.062491,"completed_at":"2026-08-23T16:56:33.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.768893] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"b2595e13143b7e7c8b360d06","created_at":"2026-08-23T16:56:32.003Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a24c5427768948f6c95332c432a34214","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.028Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-b2595e13143b7e7c8b360d06: start","job_status":"start","queue_duration_s":1.532143,"scheduling_latency_s":1.532186} gitlab # [ 278.784652] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"b2595e13143b7e7c8b360d06","created_at":"2026-08-23T16:56:32.003Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a24c5427768948f6c95332c432a34214","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.028Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-b2595e13143b7e7c8b360d06: done: 0.053326 sec","job_status":"done","queue_duration_s":1.532143,"scheduling_latency_s":1.532186,"redis_calls":12,"redis_duration_s":0.00492,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000907,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001896,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00123102,"exclusive_lock_hold_duration_s":0.011636319999999999,"duration_s":0.053326,"completed_at":"2026-08-23T16:56:33.613Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.833480] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f0bf13ebccadc4da4e40b68c","created_at":"2026-08-23T16:56:32.078Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80e078bc74d054140f17e8b53943d3d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.106Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f0bf13ebccadc4da4e40b68c: start","job_status":"start","queue_duration_s":1.510581,"scheduling_latency_s":1.510614} gitlab # [ 278.865138] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f0bf13ebccadc4da4e40b68c","created_at":"2026-08-23T16:56:32.078Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80e078bc74d054140f17e8b53943d3d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.106Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f0bf13ebccadc4da4e40b68c: done: 0.132085 sec","job_status":"done","queue_duration_s":1.510581,"scheduling_latency_s":1.510614,"redis_calls":14,"redis_duration_s":0.005449,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001524,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089262,"exclusive_lock_hold_duration_s":0.08296586,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.132085,"completed_at":"2026-08-23T16:56:33.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.919438] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.754Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"10ef8e59c8a67bc3d46f434e","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-10ef8e59c8a67bc3d46f434e: start","job_status":"start","queue_duration_s":1.602246,"scheduling_latency_s":1.602297} gitlab # [ 278.932372] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.794Z","message":"No existing merge request to be cleaned up."} gitlab # [ 278.934098] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.817Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"10ef8e59c8a67bc3d46f434e","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-10ef8e59c8a67bc3d46f434e: done: 0.06359 sec","job_status":"done","queue_duration_s":1.602246,"scheduling_latency_s":1.602297,"redis_calls":13,"redis_duration_s":0.004387,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000851,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059542,"duration_s":0.06359,"completed_at":"2026-08-23T16:56:33.817Z","load_balancing_strategy":"primary","db_duration_s":0.006843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.976996] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.820Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fd692f4d0d968e6c5f9bba88","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fd692f4d0d968e6c5f9bba88: start","job_status":"start","queue_duration_s":1.668189,"scheduling_latency_s":1.668223} gitlab # [ 278.990236] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.837Z","message":"No existing merge request to be cleaned up."} gitlab # [ 278.992091] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.849Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fd692f4d0d968e6c5f9bba88","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fd692f4d0d968e6c5f9bba88: done: 0.029184 sec","job_status":"done","queue_duration_s":1.668189,"scheduling_latency_s":1.668223,"redis_calls":10,"redis_duration_s":0.00216,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029184,"completed_at":"2026-08-23T16:56:33.849Z","load_balancing_strategy":"primary","db_duration_s":0.002722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.033114] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.851Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cd30486a1b699fb9130ed8d5","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cd30486a1b699fb9130ed8d5: start","job_status":"start","queue_duration_s":1.699369,"scheduling_latency_s":1.699401} gitlab # [ 279.045951] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.865Z","message":"No existing merge request to be cleaned up."} gitlab # [ 279.047593] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.876Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cd30486a1b699fb9130ed8d5","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cd30486a1b699fb9130ed8d5: done: 0.025576 sec","job_status":"done","queue_duration_s":1.699369,"scheduling_latency_s":1.699401,"redis_calls":10,"redis_duration_s":0.00214,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025576,"completed_at":"2026-08-23T16:56:33.876Z","load_balancing_strategy":"primary","db_duration_s":0.002068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.087118] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.878Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"17c1b1636b6d7a1b40077a8c","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-17c1b1636b6d7a1b40077a8c: start","job_status":"start","queue_duration_s":1.726642,"scheduling_latency_s":1.726672} gitlab # [ 279.100258] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.893Z","message":"No existing merge request to be cleaned up."} gitlab # [ 279.102003] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.904Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"17c1b1636b6d7a1b40077a8c","created_at":"2026-08-23T16:56:32.079Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7a666088c9b34908","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e648be1dc626bd3acc99dde545c60760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.151Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-17c1b1636b6d7a1b40077a8c: done: 0.026379 sec","job_status":"done","queue_duration_s":1.726642,"scheduling_latency_s":1.726672,"redis_calls":10,"redis_duration_s":0.0020700000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026379,"completed_at":"2026-08-23T16:56:33.904Z","load_balancing_strategy":"primary","db_duration_s":0.002407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.143309] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"03e79f2e5e88c7703df15e59","created_at":"2026-08-23T16:56:32.150Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a6cf208eaa61f6ba847caf2262cb3d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.176Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-03e79f2e5e88c7703df15e59: start","job_status":"start","queue_duration_s":1.730509,"scheduling_latency_s":1.730543} gitlab # [ 279.158885] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.923Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 279.162503] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"03e79f2e5e88c7703df15e59","created_at":"2026-08-23T16:56:32.150Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a6cf208eaa61f6ba847caf2262cb3d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.176Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-03e79f2e5e88c7703df15e59: done: 0.026325 sec","job_status":"done","queue_duration_s":1.730509,"scheduling_latency_s":1.730543,"redis_calls":10,"redis_duration_s":0.00247,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040166,"duration_s":0.026325,"completed_at":"2026-08-23T16:56:33.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.207491] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dad0b44241671fc48f845235","created_at":"2026-08-23T16:56:32.218Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc9e79ea404e7683543fb1a6f4684d94","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:56:32.247Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dad0b44241671fc48f845235: start","job_status":"start","queue_duration_s":1.68765,"scheduling_latency_s":1.687678} gitlab # [ 279.221280] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.950Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 279.224605] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.958Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dad0b44241671fc48f845235","created_at":"2026-08-23T16:56:32.218Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc9e79ea404e7683543fb1a6f4684d94","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:56:32.247Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dad0b44241671fc48f845235: done: 0.023059 sec","job_status":"done","queue_duration_s":1.68765,"scheduling_latency_s":1.687678,"redis_calls":10,"redis_duration_s":0.001504,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000318,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026414,"duration_s":0.023059,"completed_at":"2026-08-23T16:56:33.958Z","load_balancing_strategy":"primary","db_duration_s":0.000555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.266136] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:33.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0d345654df0ec6477c007103","created_at":"2026-08-23T16:56:32.295Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92f476189971bef6868d10c8c8339568","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.336Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0d345654df0ec6477c007103: start","job_status":"start","queue_duration_s":1.623761,"scheduling_latency_s":1.623782} gitlab # [ 279.378644] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0d345654df0ec6477c007103","created_at":"2026-08-23T16:56:32.295Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92f476189971bef6868d10c8c8339568","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.336Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0d345654df0ec6477c007103: done: 0.302524 sec","job_status":"done","queue_duration_s":1.623761,"scheduling_latency_s":1.623782,"redis_calls":14,"redis_duration_s":0.003679,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000743,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.245433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00077568,"exclusive_lock_hold_duration_s":0.27386058,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.302524,"completed_at":"2026-08-23T16:56:34.262Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.466569] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"247691b8ab2d72714e103240","created_at":"2026-08-23T16:56:32.368Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0eac5162ff9a891642b7be5a6126bfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.399Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-247691b8ab2d72714e103240: start","job_status":"start","queue_duration_s":1.865373,"scheduling_latency_s":1.865396} gitlab # [ 279.483415] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"247691b8ab2d72714e103240","created_at":"2026-08-23T16:56:32.368Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0eac5162ff9a891642b7be5a6126bfa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.399Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-247691b8ab2d72714e103240: done: 0.062162 sec","job_status":"done","queue_duration_s":1.865373,"scheduling_latency_s":1.865396,"redis_calls":12,"redis_duration_s":0.004563,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101194,"exclusive_lock_hold_duration_s":0.02425496,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.062162,"completed_at":"2026-08-23T16:56:34.326Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.528516] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4923e1a64449feb5bfdd39a2","created_at":"2026-08-23T16:56:32.445Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b58e003a07311b48bccf9c87c38b5141","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:56:32.484Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4923e1a64449feb5bfdd39a2: start","job_status":"start","queue_duration_s":1.844936,"scheduling_latency_s":1.844963} gitlab # [ 279.541524] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.376Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4923e1a64449feb5bfdd39a2","created_at":"2026-08-23T16:56:32.445Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b58e003a07311b48bccf9c87c38b5141","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:56:32.484Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4923e1a64449feb5bfdd39a2: done: 0.04747 sec","job_status":"done","queue_duration_s":1.844936,"scheduling_latency_s":1.844963,"redis_calls":10,"redis_duration_s":0.004264,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000908,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00067,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004537,"duration_s":0.04747,"completed_at":"2026-08-23T16:56:34.376Z","load_balancing_strategy":"primary","db_duration_s":0.008709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.582587] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e765a7329c40e28c57bd56ac","created_at":"2026-08-23T16:56:32.560Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.601Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e765a7329c40e28c57bd56ac: start","job_status":"start","queue_duration_s":1.777843,"scheduling_latency_s":1.777872} gitlab # [ 279.733449] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e765a7329c40e28c57bd56ac","created_at":"2026-08-23T16:56:32.560Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.601Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e765a7329c40e28c57bd56ac: done: 0.239497 sec","job_status":"done","queue_duration_s":1.777843,"scheduling_latency_s":1.777872,"redis_calls":71,"redis_duration_s":0.021734999999999997,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003157,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00112,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016571,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036602,"duration_s":0.239497,"completed_at":"2026-08-23T16:56:34.618Z","load_balancing_strategy":"primary","db_duration_s":0.004428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.842025] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a6e1eb263da9d46c6dcfcd1b","created_at":"2026-08-23T16:56:32.643Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c7264571ed8c1d3d4e2e0c09471f61b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.702Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a6e1eb263da9d46c6dcfcd1b: start","job_status":"start","queue_duration_s":1.917774,"scheduling_latency_s":1.917801} gitlab # [ 280.108688] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a6e1eb263da9d46c6dcfcd1b","created_at":"2026-08-23T16:56:32.643Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c7264571ed8c1d3d4e2e0c09471f61b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:56:32.702Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a6e1eb263da9d46c6dcfcd1b: done: 0.373453 sec","job_status":"done","queue_duration_s":1.917774,"scheduling_latency_s":1.917801,"redis_calls":565,"redis_duration_s":0.105392,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.102369,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.309959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041426,"duration_s":0.373453,"completed_at":"2026-08-23T16:56:34.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.181446] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:34.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24a5e5da3e4ade3edb8b08e6","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24a5e5da3e4ade3edb8b08e6: start","job_status":"start","queue_duration_s":0.387882,"scheduling_latency_s":0.387912} gitlab # [ 280.195591] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24a5e5da3e4ade3edb8b08e6","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24a5e5da3e4ade3edb8b08e6: done: 0.028288 sec","job_status":"done","queue_duration_s":0.387882,"scheduling_latency_s":0.387912,"redis_calls":16,"redis_duration_s":0.0049,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000696,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001361,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002843,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038566,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028288,"completed_at":"2026-08-23T16:56:35.024Z","load_balancing_strategy":"primary","db_duration_s":0.00125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.245246] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a8f93b348ae2b8ea795aa75","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a8f93b348ae2b8ea795aa75: start","job_status":"start","queue_duration_s":0.417943,"scheduling_latency_s":0.417967} gitlab # [ 280.258827] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a8f93b348ae2b8ea795aa75","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a8f93b348ae2b8ea795aa75: done: 0.018136 sec","job_status":"done","queue_duration_s":0.417943,"scheduling_latency_s":0.417967,"redis_calls":13,"redis_duration_s":0.003099,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018136,"completed_at":"2026-08-23T16:56:35.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.299991] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2647b541db4b61a89f14bab8","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2647b541db4b61a89f14bab8: start","job_status":"start","queue_duration_s":0.437914,"scheduling_latency_s":0.437935} gitlab # [ 280.312498] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2647b541db4b61a89f14bab8","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2647b541db4b61a89f14bab8: done: 0.016856 sec","job_status":"done","queue_duration_s":0.437914,"scheduling_latency_s":0.437935,"redis_calls":13,"redis_duration_s":0.002964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016856,"completed_at":"2026-08-23T16:56:35.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.352728] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dc4c59d65cbf2b9c9ce2848","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dc4c59d65cbf2b9c9ce2848: start","job_status":"start","queue_duration_s":0.457006,"scheduling_latency_s":0.45703} gitlab # [ 280.365138] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dc4c59d65cbf2b9c9ce2848","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dc4c59d65cbf2b9c9ce2848: done: 0.017828 sec","job_status":"done","queue_duration_s":0.457006,"scheduling_latency_s":0.45703,"redis_calls":13,"redis_duration_s":0.0033759999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017828,"completed_at":"2026-08-23T16:56:35.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.408662] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a14414cc8b2c0d7929f8137a","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a14414cc8b2c0d7929f8137a: start","job_status":"start","queue_duration_s":0.476396,"scheduling_latency_s":0.476419} gitlab # [ 280.421201] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a14414cc8b2c0d7929f8137a","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a14414cc8b2c0d7929f8137a: done: 0.017674 sec","job_status":"done","queue_duration_s":0.476396,"scheduling_latency_s":0.476419,"redis_calls":13,"redis_duration_s":0.003201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001037,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017674,"completed_at":"2026-08-23T16:56:35.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.460539] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecfe05637b97957c23bd09f","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecfe05637b97957c23bd09f: start","job_status":"start","queue_duration_s":0.49568,"scheduling_latency_s":0.4957} gitlab # [ 280.472956] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecfe05637b97957c23bd09f","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecfe05637b97957c23bd09f: done: 0.016085 sec","job_status":"done","queue_duration_s":0.49568,"scheduling_latency_s":0.4957,"redis_calls":13,"redis_duration_s":0.002747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001812,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016085,"completed_at":"2026-08-23T16:56:35.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.514512] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef85572245e6e08f7729578b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef85572245e6e08f7729578b: start","job_status":"start","queue_duration_s":0.513255,"scheduling_latency_s":0.513274} gitlab # [ 280.528913] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef85572245e6e08f7729578b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef85572245e6e08f7729578b: done: 0.020256 sec","job_status":"done","queue_duration_s":0.513255,"scheduling_latency_s":0.513274,"redis_calls":13,"redis_duration_s":0.0060360000000000006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020256,"completed_at":"2026-08-23T16:56:35.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.568801] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50bf9fc2ba17dba54a7478f2","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50bf9fc2ba17dba54a7478f2: start","job_status":"start","queue_duration_s":0.535176,"scheduling_latency_s":0.535195} gitlab # [ 280.580960] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50bf9fc2ba17dba54a7478f2","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50bf9fc2ba17dba54a7478f2: done: 0.017451 sec","job_status":"done","queue_duration_s":0.535176,"scheduling_latency_s":0.535195,"redis_calls":13,"redis_duration_s":0.0030629999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017451,"completed_at":"2026-08-23T16:56:35.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.622296] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df7374428d9d55c9682b52fa","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df7374428d9d55c9682b52fa: start","job_status":"start","queue_duration_s":0.554285,"scheduling_latency_s":0.554305} gitlab # [ 280.635403] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df7374428d9d55c9682b52fa","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df7374428d9d55c9682b52fa: done: 0.017347 sec","job_status":"done","queue_duration_s":0.554285,"scheduling_latency_s":0.554305,"redis_calls":13,"redis_duration_s":0.003288,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017347,"completed_at":"2026-08-23T16:56:35.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.676146] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9322ffe1c9c144d745e0ce3","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9322ffe1c9c144d745e0ce3: start","job_status":"start","queue_duration_s":0.574807,"scheduling_latency_s":0.574828} gitlab # [ 280.689018] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9322ffe1c9c144d745e0ce3","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9322ffe1c9c144d745e0ce3: done: 0.01655 sec","job_status":"done","queue_duration_s":0.574807,"scheduling_latency_s":0.574828,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01655,"completed_at":"2026-08-23T16:56:35.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.728380] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"818c49a3fb8d2adad06df845","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-818c49a3fb8d2adad06df845: start","job_status":"start","queue_duration_s":0.592919,"scheduling_latency_s":0.592938} gitlab # [ 280.740671] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"818c49a3fb8d2adad06df845","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-818c49a3fb8d2adad06df845: done: 0.016479 sec","job_status":"done","queue_duration_s":0.592919,"scheduling_latency_s":0.592938,"redis_calls":13,"redis_duration_s":0.0031450000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016479,"completed_at":"2026-08-23T16:56:35.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.780031] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e8154d6275cc8c509a5bcfb","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e8154d6275cc8c509a5bcfb: start","job_status":"start","queue_duration_s":0.611054,"scheduling_latency_s":0.611074} gitlab # [ 280.792289] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e8154d6275cc8c509a5bcfb","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e8154d6275cc8c509a5bcfb: done: 0.016696 sec","job_status":"done","queue_duration_s":0.611054,"scheduling_latency_s":0.611074,"redis_calls":13,"redis_duration_s":0.0030819999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001037,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016696,"completed_at":"2026-08-23T16:56:35.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.832611] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97a8fc4fb0ef50ab44600adb","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97a8fc4fb0ef50ab44600adb: start","job_status":"start","queue_duration_s":0.629381,"scheduling_latency_s":0.629402} gitlab # [ 280.844955] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97a8fc4fb0ef50ab44600adb","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97a8fc4fb0ef50ab44600adb: done: 0.017197 sec","job_status":"done","queue_duration_s":0.629381,"scheduling_latency_s":0.629402,"redis_calls":13,"redis_duration_s":0.003646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002614,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017197,"completed_at":"2026-08-23T16:56:35.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.884401] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0861f42940fef6026ade317c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0861f42940fef6026ade317c: start","job_status":"start","queue_duration_s":0.648151,"scheduling_latency_s":0.64817} gitlab # [ 280.896720] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0861f42940fef6026ade317c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0861f42940fef6026ade317c: done: 0.015242 sec","job_status":"done","queue_duration_s":0.648151,"scheduling_latency_s":0.64817,"redis_calls":13,"redis_duration_s":0.002688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015242,"completed_at":"2026-08-23T16:56:35.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.935693] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83f9b5b89c02dc8012c3ae8","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83f9b5b89c02dc8012c3ae8: start","job_status":"start","queue_duration_s":0.664837,"scheduling_latency_s":0.664855} gitlab # [ 280.948208] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83f9b5b89c02dc8012c3ae8","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83f9b5b89c02dc8012c3ae8: done: 0.015457 sec","job_status":"done","queue_duration_s":0.664837,"scheduling_latency_s":0.664855,"redis_calls":13,"redis_duration_s":0.002646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015457,"completed_at":"2026-08-23T16:56:35.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.987394] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1956e30afe14c8a70afbba73","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1956e30afe14c8a70afbba73: start","job_status":"start","queue_duration_s":0.682185,"scheduling_latency_s":0.68221} gitlab # [ 280.999961] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1956e30afe14c8a70afbba73","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1956e30afe14c8a70afbba73: done: 0.025374 sec","job_status":"done","queue_duration_s":0.682185,"scheduling_latency_s":0.68221,"redis_calls":13,"redis_duration_s":0.008818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006632,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025374,"completed_at":"2026-08-23T16:56:35.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.040637] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3ea6fd617803e17b1f30882","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3ea6fd617803e17b1f30882: start","job_status":"start","queue_duration_s":0.70947,"scheduling_latency_s":0.709494} gitlab # [ 281.052746] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3ea6fd617803e17b1f30882","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3ea6fd617803e17b1f30882: done: 0.019303 sec","job_status":"done","queue_duration_s":0.70947,"scheduling_latency_s":0.709494,"redis_calls":13,"redis_duration_s":0.003774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019303,"completed_at":"2026-08-23T16:56:35.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.092396] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa16a538b2c9820ca389f956","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa16a538b2c9820ca389f956: start","job_status":"start","queue_duration_s":0.730885,"scheduling_latency_s":0.730911} gitlab # [ 281.104677] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa16a538b2c9820ca389f956","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa16a538b2c9820ca389f956: done: 0.02099 sec","job_status":"done","queue_duration_s":0.730885,"scheduling_latency_s":0.730911,"redis_calls":13,"redis_duration_s":0.004357,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002431,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02099,"completed_at":"2026-08-23T16:56:35.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.143893] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42d35b8d546f0246a593a187","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42d35b8d546f0246a593a187: start","job_status":"start","queue_duration_s":0.75389,"scheduling_latency_s":0.753918} gitlab # [ 281.156594] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42d35b8d546f0246a593a187","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42d35b8d546f0246a593a187: done: 0.020562 sec","job_status":"done","queue_duration_s":0.75389,"scheduling_latency_s":0.753918,"redis_calls":13,"redis_duration_s":0.0038450000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002467,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020562,"completed_at":"2026-08-23T16:56:35.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.196029] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a669c8fa7bb8ad172d378ebb","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a669c8fa7bb8ad172d378ebb: start","job_status":"start","queue_duration_s":0.776785,"scheduling_latency_s":0.776814} gitlab # [ 281.208260] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a669c8fa7bb8ad172d378ebb","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a669c8fa7bb8ad172d378ebb: done: 0.019804 sec","job_status":"done","queue_duration_s":0.776785,"scheduling_latency_s":0.776814,"redis_calls":13,"redis_duration_s":0.003664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019804,"completed_at":"2026-08-23T16:56:35.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.248643] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"824d65bff7c62786f6f89141","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-824d65bff7c62786f6f89141: start","job_status":"start","queue_duration_s":0.798489,"scheduling_latency_s":0.798517} gitlab # [ 281.260937] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"824d65bff7c62786f6f89141","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-824d65bff7c62786f6f89141: done: 0.019631 sec","job_status":"done","queue_duration_s":0.798489,"scheduling_latency_s":0.798517,"redis_calls":13,"redis_duration_s":0.0034339999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002315,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019631,"completed_at":"2026-08-23T16:56:35.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.299886] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b607298a769865f12aed860b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b607298a769865f12aed860b: start","job_status":"start","queue_duration_s":0.8199,"scheduling_latency_s":0.819926} gitlab # [ 281.312477] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b607298a769865f12aed860b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b607298a769865f12aed860b: done: 0.019266 sec","job_status":"done","queue_duration_s":0.8199,"scheduling_latency_s":0.819926,"redis_calls":13,"redis_duration_s":0.002998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019266,"completed_at":"2026-08-23T16:56:35.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.351616] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13cebeaa943ed227e2961d9","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13cebeaa943ed227e2961d9: start","job_status":"start","queue_duration_s":0.841852,"scheduling_latency_s":0.841881} gitlab # [ 281.364277] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13cebeaa943ed227e2961d9","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13cebeaa943ed227e2961d9: done: 0.019398 sec","job_status":"done","queue_duration_s":0.841852,"scheduling_latency_s":0.841881,"redis_calls":13,"redis_duration_s":0.003198,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019398,"completed_at":"2026-08-23T16:56:35.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.403362] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84a5c558f204491b1b56327","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84a5c558f204491b1b56327: start","job_status":"start","queue_duration_s":0.863085,"scheduling_latency_s":0.863107} gitlab # [ 281.416049] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84a5c558f204491b1b56327","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84a5c558f204491b1b56327: done: 0.016092 sec","job_status":"done","queue_duration_s":0.863085,"scheduling_latency_s":0.863107,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016092,"completed_at":"2026-08-23T16:56:35.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.456644] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed1319ef15b6ef6805605969","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed1319ef15b6ef6805605969: start","job_status":"start","queue_duration_s":0.880654,"scheduling_latency_s":0.880673} gitlab # [ 281.469129] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed1319ef15b6ef6805605969","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed1319ef15b6ef6805605969: done: 0.015703 sec","job_status":"done","queue_duration_s":0.880654,"scheduling_latency_s":0.880673,"redis_calls":13,"redis_duration_s":0.002832,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-08-23T16:56:35.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.508368] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d8847672bbcb4fe9fd0587b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d8847672bbcb4fe9fd0587b: start","job_status":"start","queue_duration_s":0.898232,"scheduling_latency_s":0.898251} gitlab # [ 281.520529] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d8847672bbcb4fe9fd0587b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d8847672bbcb4fe9fd0587b: done: 0.016286 sec","job_status":"done","queue_duration_s":0.898232,"scheduling_latency_s":0.898251,"redis_calls":13,"redis_duration_s":0.002965,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016286,"completed_at":"2026-08-23T16:56:35.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.559717] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c4f4ae99e7a8485f8cd5056","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c4f4ae99e7a8485f8cd5056: start","job_status":"start","queue_duration_s":0.916048,"scheduling_latency_s":0.916067} gitlab # [ 281.572355] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c4f4ae99e7a8485f8cd5056","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c4f4ae99e7a8485f8cd5056: done: 0.016387 sec","job_status":"done","queue_duration_s":0.916048,"scheduling_latency_s":0.916067,"redis_calls":13,"redis_duration_s":0.002994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016387,"completed_at":"2026-08-23T16:56:35.540Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.611234] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d499ddf934bca59ac28869e4","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d499ddf934bca59ac28869e4: start","job_status":"start","queue_duration_s":0.934033,"scheduling_latency_s":0.934054} gitlab # [ 281.624282] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d499ddf934bca59ac28869e4","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d499ddf934bca59ac28869e4: done: 0.016165 sec","job_status":"done","queue_duration_s":0.934033,"scheduling_latency_s":0.934054,"redis_calls":13,"redis_duration_s":0.002909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016165,"completed_at":"2026-08-23T16:56:35.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.666259] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2046fd9671491e762bc3a30","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2046fd9671491e762bc3a30: start","job_status":"start","queue_duration_s":0.951817,"scheduling_latency_s":0.951837} gitlab # [ 281.680234] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2046fd9671491e762bc3a30","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2046fd9671491e762bc3a30: done: 0.031649 sec","job_status":"done","queue_duration_s":0.951817,"scheduling_latency_s":0.951837,"redis_calls":13,"redis_duration_s":0.016427,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.013358,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031649,"completed_at":"2026-08-23T16:56:35.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.723151] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb3d2cc0e312a38b5fd9ae1b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb3d2cc0e312a38b5fd9ae1b: start","job_status":"start","queue_duration_s":0.985613,"scheduling_latency_s":0.985636} gitlab # [ 281.735774] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb3d2cc0e312a38b5fd9ae1b","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb3d2cc0e312a38b5fd9ae1b: done: 0.016547 sec","job_status":"done","queue_duration_s":0.985613,"scheduling_latency_s":0.985636,"redis_calls":13,"redis_duration_s":0.003016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016547,"completed_at":"2026-08-23T16:56:35.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.775144] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5ae07472245fce5295c1b4","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5ae07472245fce5295c1b4: start","job_status":"start","queue_duration_s":1.003743,"scheduling_latency_s":1.003761} gitlab # [ 281.787633] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5ae07472245fce5295c1b4","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5ae07472245fce5295c1b4: done: 0.016426 sec","job_status":"done","queue_duration_s":1.003743,"scheduling_latency_s":1.003761,"redis_calls":13,"redis_duration_s":0.002854,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016426,"completed_at":"2026-08-23T16:56:35.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.827306] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a2e27d3d6bfe9ca9bbef71c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a2e27d3d6bfe9ca9bbef71c: start","job_status":"start","queue_duration_s":1.021782,"scheduling_latency_s":1.021802} gitlab # [ 281.841836] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a2e27d3d6bfe9ca9bbef71c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a2e27d3d6bfe9ca9bbef71c: done: 0.0167 sec","job_status":"done","queue_duration_s":1.021782,"scheduling_latency_s":1.021802,"redis_calls":13,"redis_duration_s":0.0030470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0167,"completed_at":"2026-08-23T16:56:35.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.885346] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01cec15cfdde7d611c69c65","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01cec15cfdde7d611c69c65: start","job_status":"start","queue_duration_s":1.04023,"scheduling_latency_s":1.040249} gitlab # [ 281.898471] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d01cec15cfdde7d611c69c65","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d01cec15cfdde7d611c69c65: done: 0.017253 sec","job_status":"done","queue_duration_s":1.04023,"scheduling_latency_s":1.040249,"redis_calls":13,"redis_duration_s":0.003475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017253,"completed_at":"2026-08-23T16:56:35.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.939776] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a285e8c0249a5a6106e5d438","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a285e8c0249a5a6106e5d438: start","job_status":"start","queue_duration_s":1.059082,"scheduling_latency_s":1.059101} gitlab # [ 281.954285] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a285e8c0249a5a6106e5d438","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a285e8c0249a5a6106e5d438: done: 0.022076 sec","job_status":"done","queue_duration_s":1.059082,"scheduling_latency_s":1.059101,"redis_calls":13,"redis_duration_s":0.004337,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022076,"completed_at":"2026-08-23T16:56:35.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.998561] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899bcf6f4e347e2fc3770470","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899bcf6f4e347e2fc3770470: start","job_status":"start","queue_duration_s":1.083107,"scheduling_latency_s":1.083129} gitlab # [ 282.012367] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899bcf6f4e347e2fc3770470","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899bcf6f4e347e2fc3770470: done: 0.019991 sec","job_status":"done","queue_duration_s":1.083107,"scheduling_latency_s":1.083129,"redis_calls":13,"redis_duration_s":0.003492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002309,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019991,"completed_at":"2026-08-23T16:56:35.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.054344] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c54343286531be36e1aaa83d","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c54343286531be36e1aaa83d: start","job_status":"start","queue_duration_s":1.105111,"scheduling_latency_s":1.105137} gitlab # [ 282.068910] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c54343286531be36e1aaa83d","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c54343286531be36e1aaa83d: done: 0.016868 sec","job_status":"done","queue_duration_s":1.105111,"scheduling_latency_s":1.105137,"redis_calls":13,"redis_duration_s":0.002847,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016868,"completed_at":"2026-08-23T16:56:35.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.113336] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0022b676ae69c1819d0502b7","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0022b676ae69c1819d0502b7: start","job_status":"start","queue_duration_s":1.123974,"scheduling_latency_s":1.123993} gitlab # [ 282.126732] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0022b676ae69c1819d0502b7","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0022b676ae69c1819d0502b7: done: 0.016314 sec","job_status":"done","queue_duration_s":1.123974,"scheduling_latency_s":1.123993,"redis_calls":13,"redis_duration_s":0.002882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016314,"completed_at":"2026-08-23T16:56:35.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.168433] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab05d2554611d043210fc401","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab05d2554611d043210fc401: start","job_status":"start","queue_duration_s":1.141984,"scheduling_latency_s":1.142002} gitlab # [ 282.182590] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab05d2554611d043210fc401","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab05d2554611d043210fc401: done: 0.016668 sec","job_status":"done","queue_duration_s":1.141984,"scheduling_latency_s":1.142002,"redis_calls":13,"redis_duration_s":0.0029769999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016668,"completed_at":"2026-08-23T16:56:35.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.225702] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3895e706bc156fc6bcc0231c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3895e706bc156fc6bcc0231c: start","job_status":"start","queue_duration_s":1.160195,"scheduling_latency_s":1.160213} gitlab # [ 282.239886] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3895e706bc156fc6bcc0231c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3895e706bc156fc6bcc0231c: done: 0.016224 sec","job_status":"done","queue_duration_s":1.160195,"scheduling_latency_s":1.160213,"redis_calls":13,"redis_duration_s":0.0030210000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016224,"completed_at":"2026-08-23T16:56:35.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.284850] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60cc6134a72aa13bb5f56fea","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60cc6134a72aa13bb5f56fea: start","job_status":"start","queue_duration_s":1.178092,"scheduling_latency_s":1.178111} gitlab # [ 282.298889] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60cc6134a72aa13bb5f56fea","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60cc6134a72aa13bb5f56fea: done: 0.017458 sec","job_status":"done","queue_duration_s":1.178092,"scheduling_latency_s":1.178111,"redis_calls":13,"redis_duration_s":0.0030350000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017458,"completed_at":"2026-08-23T16:56:35.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.339934] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dc6d365658ce816e244fd7c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dc6d365658ce816e244fd7c: start","job_status":"start","queue_duration_s":1.197175,"scheduling_latency_s":1.197193} gitlab # [ 282.352970] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dc6d365658ce816e244fd7c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dc6d365658ce816e244fd7c: done: 0.017358 sec","job_status":"done","queue_duration_s":1.197175,"scheduling_latency_s":1.197193,"redis_calls":13,"redis_duration_s":0.003496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002431,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017358,"completed_at":"2026-08-23T16:56:35.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.394213] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc6656ad1521b65e5a24f0b7","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc6656ad1521b65e5a24f0b7: start","job_status":"start","queue_duration_s":1.217021,"scheduling_latency_s":1.217073} gitlab # [ 282.407097] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc6656ad1521b65e5a24f0b7","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc6656ad1521b65e5a24f0b7: done: 0.044014 sec","job_status":"done","queue_duration_s":1.217021,"scheduling_latency_s":1.217073,"redis_calls":13,"redis_duration_s":0.004376,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044014,"completed_at":"2026-08-23T16:56:35.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.449551] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30b47ec31576c58006769198","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30b47ec31576c58006769198: start","job_status":"start","queue_duration_s":1.264275,"scheduling_latency_s":1.264325} gitlab # [ 282.463592] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30b47ec31576c58006769198","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30b47ec31576c58006769198: done: 0.036399 sec","job_status":"done","queue_duration_s":1.264275,"scheduling_latency_s":1.264325,"redis_calls":13,"redis_duration_s":0.004024,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036399,"completed_at":"2026-08-23T16:56:35.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.507134] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57dd16d251194a7f9f992ca9","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57dd16d251194a7f9f992ca9: start","job_status":"start","queue_duration_s":1.30348,"scheduling_latency_s":1.303536} gitlab # [ 282.521215] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57dd16d251194a7f9f992ca9","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57dd16d251194a7f9f992ca9: done: 0.040279 sec","job_status":"done","queue_duration_s":1.30348,"scheduling_latency_s":1.303536,"redis_calls":13,"redis_duration_s":0.0036880000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002376,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040279,"completed_at":"2026-08-23T16:56:35.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.562837] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47f36a55f4f169af5455d82c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47f36a55f4f169af5455d82c: start","job_status":"start","queue_duration_s":1.347041,"scheduling_latency_s":1.347082} gitlab # [ 282.576201] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47f36a55f4f169af5455d82c","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47f36a55f4f169af5455d82c: done: 0.023921 sec","job_status":"done","queue_duration_s":1.347041,"scheduling_latency_s":1.347082,"redis_calls":13,"redis_duration_s":0.002186,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001401,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023921,"completed_at":"2026-08-23T16:56:35.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.618766] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:35.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a959ec14c857914d571f35d","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a959ec14c857914d571f35d: start","job_status":"start","queue_duration_s":1.373408,"scheduling_latency_s":1.373445} gitlab # [ 282.632305] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a959ec14c857914d571f35d","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a959ec14c857914d571f35d: done: 0.021716 sec","job_status":"done","queue_duration_s":1.373408,"scheduling_latency_s":1.373445,"redis_calls":13,"redis_duration_s":0.002079,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001335,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021716,"completed_at":"2026-08-23T16:56:36.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.674970] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"414ad3e49112159ac777d2a9","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-414ad3e49112159ac777d2a9: start","job_status":"start","queue_duration_s":1.397276,"scheduling_latency_s":1.397313} gitlab # [ 282.688653] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"414ad3e49112159ac777d2a9","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-414ad3e49112159ac777d2a9: done: 0.019678 sec","job_status":"done","queue_duration_s":1.397276,"scheduling_latency_s":1.397313,"redis_calls":13,"redis_duration_s":0.0018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019678,"completed_at":"2026-08-23T16:56:36.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.730090] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ac55b5fc9eac8ca29ef9570","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ac55b5fc9eac8ca29ef9570: start","job_status":"start","queue_duration_s":1.419431,"scheduling_latency_s":1.419464} gitlab # [ 282.743271] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ac55b5fc9eac8ca29ef9570","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ac55b5fc9eac8ca29ef9570: done: 0.020139 sec","job_status":"done","queue_duration_s":1.419431,"scheduling_latency_s":1.419464,"redis_calls":13,"redis_duration_s":0.002048,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020139,"completed_at":"2026-08-23T16:56:36.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.785396] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c901cf9ee188329313414fc","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c901cf9ee188329313414fc: start","job_status":"start","queue_duration_s":1.442089,"scheduling_latency_s":1.442127} gitlab # [ 282.798692] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c901cf9ee188329313414fc","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c901cf9ee188329313414fc: done: 0.03324 sec","job_status":"done","queue_duration_s":1.442089,"scheduling_latency_s":1.442127,"redis_calls":13,"redis_duration_s":0.0042190000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03324,"completed_at":"2026-08-23T16:56:36.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.839957] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a2923737164d4745444f603","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a2923737164d4745444f603: start","job_status":"start","queue_duration_s":1.479042,"scheduling_latency_s":1.479103} gitlab # [ 282.879892] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:56:36.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a2923737164d4745444f603","created_at":"2026-08-23T16:56:34.407Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-300a888f114c47a7","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"78ac62c04a259ba681815bb25f3dd123","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:56:34.608Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a2923737164d4745444f603: done: 0.045491 sec","job_status":"done","queue_duration_s":1.479042,"scheduling_latency_s":1.479103,"redis_calls":13,"redis_duration_s":0.005842,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045491,"completed_at":"2026-08-23T16:56:36.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 306.531851] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b4d03e8ac239420268b8af7d","created_at":"2026-08-23T16:57:01.398Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5ba440de5850274d73d6be247221d42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.412Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b4d03e8ac239420268b8af7d: start","job_status":"start","queue_duration_s":0.003691,"scheduling_latency_s":0.003737} gitlab # [ 306.688151] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b4d03e8ac239420268b8af7d","created_at":"2026-08-23T16:57:01.398Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5ba440de5850274d73d6be247221d42","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.412Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b4d03e8ac239420268b8af7d: done: 0.156875 sec","job_status":"done","queue_duration_s":0.003691,"scheduling_latency_s":0.003737,"redis_calls":8,"redis_duration_s":0.020255,"redis_read_bytes":133,"redis_write_bytes":840,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001121,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":64,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01358,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005554,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.156875,"completed_at":"2026-08-23T16:57:01.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 306.796211] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8b399469af0e833725eb7ce0","created_at":"2026-08-23T16:57:01.454Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7dc19cd3927e9c7ec81ea6fa6bdf7b3a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.461Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8b399469af0e833725eb7ce0: start","job_status":"start","queue_duration_s":0.119234,"scheduling_latency_s":0.11929} gitlab # [ 306.818737] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8b399469af0e833725eb7ce0","created_at":"2026-08-23T16:57:01.454Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7dc19cd3927e9c7ec81ea6fa6bdf7b3a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.461Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8b399469af0e833725eb7ce0: done: 0.077149 sec","job_status":"done","queue_duration_s":0.119234,"scheduling_latency_s":0.11929,"redis_calls":7,"redis_duration_s":0.002872,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077149,"completed_at":"2026-08-23T16:57:01.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 306.873245] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b27491c65cc774fd6e86d058","created_at":"2026-08-23T16:57:01.480Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.486Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b27491c65cc774fd6e86d058: start","job_status":"start","queue_duration_s":0.179145,"scheduling_latency_s":0.179208} gitlab # [ 307.043301] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b27491c65cc774fd6e86d058","created_at":"2026-08-23T16:57:01.480Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.486Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b27491c65cc774fd6e86d058: done: 0.262581 sec","job_status":"done","queue_duration_s":0.179145,"scheduling_latency_s":0.179208,"redis_calls":14,"redis_duration_s":0.05299,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.004894,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.045287,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002809,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.262581,"completed_at":"2026-08-23T16:57:01.927Z","load_balancing_strategy":"primary","db_duration_s":0.054702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.106038] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:01.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"55b3f6e0e7fba0bbee3e9370","created_at":"2026-08-23T16:57:01.497Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b47d9613ccfb94e0d3d5eb2b25d0b91","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.502Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-55b3f6e0e7fba0bbee3e9370: start","job_status":"start","queue_duration_s":0.43077,"scheduling_latency_s":0.430832} gitlab # [ 307.166211] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.051Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 307.267037] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"55b3f6e0e7fba0bbee3e9370","created_at":"2026-08-23T16:57:01.497Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b47d9613ccfb94e0d3d5eb2b25d0b91","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.502Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-55b3f6e0e7fba0bbee3e9370: done: 0.218328 sec","job_status":"done","queue_duration_s":0.43077,"scheduling_latency_s":0.430832,"redis_calls":7,"redis_duration_s":0.006933,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.218328,"completed_at":"2026-08-23T16:57:02.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.363941] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"25e0e7c852318d55b1f0d903","created_at":"2026-08-23T16:57:01.526Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73bd3a106716e43d686782349510f796","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.548Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-25e0e7c852318d55b1f0d903: start","job_status":"start","queue_duration_s":0.610175,"scheduling_latency_s":0.610233} gitlab # [ 307.406976] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"25e0e7c852318d55b1f0d903","created_at":"2026-08-23T16:57:01.526Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73bd3a106716e43d686782349510f796","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.548Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-25e0e7c852318d55b1f0d903: done: 0.132451 sec","job_status":"done","queue_duration_s":0.610175,"scheduling_latency_s":0.610233,"redis_calls":10,"redis_duration_s":0.006653,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003347,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003306,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0257493,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.132451,"completed_at":"2026-08-23T16:57:02.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018363,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 307.477269] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"680fdd49051b4bb6c044b2d1","created_at":"2026-08-23T16:57:01.565Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9b05f3a47f195d88816ad7cf297a283","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:57:01.577Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-680fdd49051b4bb6c044b2d1: start","job_status":"start","queue_duration_s":0.717671,"scheduling_latency_s":0.717725} gitlab # [ 307.492340] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.327Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 307.496321] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"680fdd49051b4bb6c044b2d1","created_at":"2026-08-23T16:57:01.565Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9b05f3a47f195d88816ad7cf297a283","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:57:01.577Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-680fdd49051b4bb6c044b2d1: done: 0.058181 sec","job_status":"done","queue_duration_s":0.717671,"scheduling_latency_s":0.717725,"redis_calls":7,"redis_duration_s":0.002643,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058181,"completed_at":"2026-08-23T16:57:02.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.539818] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cb50e3e621a4e22bff2db9d1","created_at":"2026-08-23T16:57:01.644Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48cab39e32458d458c214444cbc73186","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.652Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cb50e3e621a4e22bff2db9d1: start","job_status":"start","queue_duration_s":0.706091,"scheduling_latency_s":0.706149} gitlab # [ 307.556627] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cb50e3e621a4e22bff2db9d1","created_at":"2026-08-23T16:57:01.644Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48cab39e32458d458c214444cbc73186","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.652Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cb50e3e621a4e22bff2db9d1: done: 0.061545 sec","job_status":"done","queue_duration_s":0.706091,"scheduling_latency_s":0.706149,"redis_calls":7,"redis_duration_s":0.002232,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061545,"completed_at":"2026-08-23T16:57:02.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.597130] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e7bfd1051b13ff38c5e1d3bc","created_at":"2026-08-23T16:57:01.683Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfdb53337aad0ed5eb1cf0e8012bccb2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.691Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e7bfd1051b13ff38c5e1d3bc: start","job_status":"start","queue_duration_s":0.73129,"scheduling_latency_s":0.73134} gitlab # [ 307.611132] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e7bfd1051b13ff38c5e1d3bc","created_at":"2026-08-23T16:57:01.683Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfdb53337aad0ed5eb1cf0e8012bccb2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.691Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e7bfd1051b13ff38c5e1d3bc: done: 0.036334 sec","job_status":"done","queue_duration_s":0.73129,"scheduling_latency_s":0.73134,"redis_calls":7,"redis_duration_s":0.001999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.036334,"completed_at":"2026-08-23T16:57:02.458Z","load_balancing_strategy":"primary","db_duration_s":0.009399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.652761] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.461Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8b35128cf335263f17cdf40b","created_at":"2026-08-23T16:57:01.711Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9fa427648bb6fe2e73fc676b1610d52e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.718Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8b35128cf335263f17cdf40b: start","job_status":"start","queue_duration_s":0.742569,"scheduling_latency_s":0.742602} gitlab # [ 307.666971] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8b35128cf335263f17cdf40b","created_at":"2026-08-23T16:57:01.711Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9fa427648bb6fe2e73fc676b1610d52e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.718Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8b35128cf335263f17cdf40b: done: 0.036699 sec","job_status":"done","queue_duration_s":0.742569,"scheduling_latency_s":0.742602,"redis_calls":7,"redis_duration_s":0.0020369999999999997,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001294,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036699,"completed_at":"2026-08-23T16:57:02.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.708040] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"45beccff6cf665ff0767a0c5","created_at":"2026-08-23T16:57:01.797Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"214728a13005afc62519b06991b96111","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.808Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-45beccff6cf665ff0767a0c5: start","job_status":"start","queue_duration_s":0.691382,"scheduling_latency_s":0.691418} gitlab # [ 307.721740] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"45beccff6cf665ff0767a0c5","created_at":"2026-08-23T16:57:01.797Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"214728a13005afc62519b06991b96111","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.808Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-45beccff6cf665ff0767a0c5: done: 0.024171 sec","job_status":"done","queue_duration_s":0.691382,"scheduling_latency_s":0.691418,"redis_calls":9,"redis_duration_s":0.001887,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088668,"exclusive_lock_hold_duration_s":0.00470316,"duration_s":0.024171,"completed_at":"2026-08-23T16:57:02.523Z","load_balancing_strategy":"primary","db_duration_s":0.001356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.763664] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.525Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24ef6b67a77e1f1085919c64","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24ef6b67a77e1f1085919c64: start","job_status":"start","queue_duration_s":0.671403,"scheduling_latency_s":0.671424} gitlab # [ 307.776345] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.536Z","message":"No existing merge request to be cleaned up."} gitlab # [ 307.778034] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.544Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24ef6b67a77e1f1085919c64","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24ef6b67a77e1f1085919c64: done: 0.019718 sec","job_status":"done","queue_duration_s":0.671403,"scheduling_latency_s":0.671424,"redis_calls":10,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019718,"completed_at":"2026-08-23T16:57:02.544Z","load_balancing_strategy":"primary","db_duration_s":0.001681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.816665] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.546Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b80f21b53e74385023a23b4d","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b80f21b53e74385023a23b4d: start","job_status":"start","queue_duration_s":0.692362,"scheduling_latency_s":0.692382} gitlab # [ 307.829224] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.556Z","message":"No existing merge request to be cleaned up."} gitlab # [ 307.831020] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.564Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b80f21b53e74385023a23b4d","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b80f21b53e74385023a23b4d: done: 0.018738 sec","job_status":"done","queue_duration_s":0.692362,"scheduling_latency_s":0.692382,"redis_calls":10,"redis_duration_s":0.001426,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000815,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018738,"completed_at":"2026-08-23T16:57:02.564Z","load_balancing_strategy":"primary","db_duration_s":0.001476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.870758] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.566Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"42e4605ba7d7503147a65733","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-42e4605ba7d7503147a65733: start","job_status":"start","queue_duration_s":0.712393,"scheduling_latency_s":0.712414} gitlab # [ 307.884428] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.577Z","message":"No existing merge request to be cleaned up."} gitlab # [ 307.886262] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.585Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"42e4605ba7d7503147a65733","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-42e4605ba7d7503147a65733: done: 0.019251 sec","job_status":"done","queue_duration_s":0.712393,"scheduling_latency_s":0.712414,"redis_calls":10,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019251,"completed_at":"2026-08-23T16:57:02.585Z","load_balancing_strategy":"primary","db_duration_s":0.001381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.928052] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.586Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b52705135348e55810cfa6d","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b52705135348e55810cfa6d: start","job_status":"start","queue_duration_s":0.732946,"scheduling_latency_s":0.732965} gitlab # [ 307.940639] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.596Z","message":"No existing merge request to be cleaned up."} gitlab # [ 307.942372] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.605Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b52705135348e55810cfa6d","created_at":"2026-08-23T16:57:01.803Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-a0ad7f3d9e94483e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdf1854efe9e100b87cc9f921d66514a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.853Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b52705135348e55810cfa6d: done: 0.018816 sec","job_status":"done","queue_duration_s":0.732946,"scheduling_latency_s":0.732965,"redis_calls":10,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018816,"completed_at":"2026-08-23T16:57:02.605Z","load_balancing_strategy":"primary","db_duration_s":0.001391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.984366] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9062d8a19cd2d1e6985a024b","created_at":"2026-08-23T16:57:01.845Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b2b2161971a75ae46d5a481057ed75a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.858Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9062d8a19cd2d1e6985a024b: start","job_status":"start","queue_duration_s":0.748762,"scheduling_latency_s":0.748782} gitlab # [ 308.002368] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.617Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 308.006717] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9062d8a19cd2d1e6985a024b","created_at":"2026-08-23T16:57:01.845Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b2b2161971a75ae46d5a481057ed75a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.858Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9062d8a19cd2d1e6985a024b: done: 0.016068 sec","job_status":"done","queue_duration_s":0.748762,"scheduling_latency_s":0.748782,"redis_calls":7,"redis_duration_s":0.001147,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016068,"completed_at":"2026-08-23T16:57:02.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.049180] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f9a5af757388666b3e52b269","created_at":"2026-08-23T16:57:01.913Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6e53825b8b93f05245caf670faecc4e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.922Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f9a5af757388666b3e52b269: start","job_status":"start","queue_duration_s":0.702192,"scheduling_latency_s":0.702211} gitlab # [ 308.064131] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.632Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 308.067485] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f9a5af757388666b3e52b269","created_at":"2026-08-23T16:57:01.913Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6e53825b8b93f05245caf670faecc4e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.922Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f9a5af757388666b3e52b269: done: 0.017107 sec","job_status":"done","queue_duration_s":0.702192,"scheduling_latency_s":0.702211,"redis_calls":7,"redis_duration_s":0.0012259999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017107,"completed_at":"2026-08-23T16:57:02.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.109049] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b144e48d522c0eb62cce0045","created_at":"2026-08-23T16:57:01.960Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab9d8a86999ea08278422c5290e8c29f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.967Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b144e48d522c0eb62cce0045: start","job_status":"start","queue_duration_s":0.675282,"scheduling_latency_s":0.675302} gitlab # [ 308.123478] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b144e48d522c0eb62cce0045","created_at":"2026-08-23T16:57:01.960Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab9d8a86999ea08278422c5290e8c29f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.967Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b144e48d522c0eb62cce0045: done: 0.018636 sec","job_status":"done","queue_duration_s":0.675282,"scheduling_latency_s":0.675302,"redis_calls":9,"redis_duration_s":0.001657,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057488,"exclusive_lock_hold_duration_s":0.00373772,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.018636,"completed_at":"2026-08-23T16:57:02.661Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.168165] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"798c6c9fd1a5d65a9359703d","created_at":"2026-08-23T16:57:01.984Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90bc5c2d6dc5eac01b1401c8aefe2bfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.990Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-798c6c9fd1a5d65a9359703d: start","job_status":"start","queue_duration_s":0.672641,"scheduling_latency_s":0.672662} gitlab # [ 308.182587] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"798c6c9fd1a5d65a9359703d","created_at":"2026-08-23T16:57:01.984Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90bc5c2d6dc5eac01b1401c8aefe2bfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:01.990Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-798c6c9fd1a5d65a9359703d: done: 0.088218 sec","job_status":"done","queue_duration_s":0.672641,"scheduling_latency_s":0.672662,"redis_calls":9,"redis_duration_s":0.002606,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060014,"exclusive_lock_hold_duration_s":0.06830848,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.088218,"completed_at":"2026-08-23T16:57:02.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.226489] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fb74ace638e3a9332f0fa3fd","created_at":"2026-08-23T16:57:02.003Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17239bfa97cf6e21a4a64a19ce8cea4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.009Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fb74ace638e3a9332f0fa3fd: start","job_status":"start","queue_duration_s":0.743894,"scheduling_latency_s":0.743925} gitlab # [ 308.241250] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.765Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 308.244422] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fb74ace638e3a9332f0fa3fd","created_at":"2026-08-23T16:57:02.003Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17239bfa97cf6e21a4a64a19ce8cea4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.009Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fb74ace638e3a9332f0fa3fd: done: 0.019277 sec","job_status":"done","queue_duration_s":0.743894,"scheduling_latency_s":0.743925,"redis_calls":7,"redis_duration_s":0.001418,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019277,"completed_at":"2026-08-23T16:57:02.772Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.285626] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d72e5c6cb70ba9754a42c681","created_at":"2026-08-23T16:57:02.022Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e580f6eaf171f26a1f287d56b3e8789","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:57:02.027Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d72e5c6cb70ba9754a42c681: start","job_status":"start","queue_duration_s":0.747107,"scheduling_latency_s":0.747132} gitlab # [ 308.299288] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.782Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 308.302819] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d72e5c6cb70ba9754a42c681","created_at":"2026-08-23T16:57:02.022Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e580f6eaf171f26a1f287d56b3e8789","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:57:02.027Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d72e5c6cb70ba9754a42c681: done: 0.013498 sec","job_status":"done","queue_duration_s":0.747107,"scheduling_latency_s":0.747132,"redis_calls":7,"redis_duration_s":0.000997,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013498,"completed_at":"2026-08-23T16:57:02.787Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.342893] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:02.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9b1b733947b0a4832e23c0eb","created_at":"2026-08-23T16:57:02.070Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba12fe1a6e5c2069752138169c7fe1e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.082Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9b1b733947b0a4832e23c0eb: start","job_status":"start","queue_duration_s":0.706531,"scheduling_latency_s":0.706549} gitlab # [ 308.357264] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.129Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9b1b733947b0a4832e23c0eb","created_at":"2026-08-23T16:57:02.070Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba12fe1a6e5c2069752138169c7fe1e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.082Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9b1b733947b0a4832e23c0eb: done: 0.340516 sec","job_status":"done","queue_duration_s":0.706531,"scheduling_latency_s":0.706549,"redis_calls":9,"redis_duration_s":0.001617,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.068,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.242683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047874,"exclusive_lock_hold_duration_s":0.32553838,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.340516,"completed_at":"2026-08-23T16:57:03.129Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.116186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.401768] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ff696eed22ebaf979ee5cccc","created_at":"2026-08-23T16:57:02.135Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddc84508a3dc8b6f31833d929a4afbde","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.155Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ff696eed22ebaf979ee5cccc: start","job_status":"start","queue_duration_s":0.97603,"scheduling_latency_s":0.976053} gitlab # [ 308.416550] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ff696eed22ebaf979ee5cccc","created_at":"2026-08-23T16:57:02.135Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddc84508a3dc8b6f31833d929a4afbde","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.155Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ff696eed22ebaf979ee5cccc: done: 0.05735 sec","job_status":"done","queue_duration_s":0.97603,"scheduling_latency_s":0.976053,"redis_calls":9,"redis_duration_s":0.002621,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00133604,"exclusive_lock_hold_duration_s":0.024069,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.05735,"completed_at":"2026-08-23T16:57:03.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.460533] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7574cb9e53b6e7fad0a2029a","created_at":"2026-08-23T16:57:02.199Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16afc23a95f8405f2c63946f838e8d3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:57:02.206Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7574cb9e53b6e7fad0a2029a: start","job_status":"start","queue_duration_s":0.98647,"scheduling_latency_s":0.986516} gitlab # [ 308.473989] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7574cb9e53b6e7fad0a2029a","created_at":"2026-08-23T16:57:02.199Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16afc23a95f8405f2c63946f838e8d3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:57:02.206Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7574cb9e53b6e7fad0a2029a: done: 0.050323 sec","job_status":"done","queue_duration_s":0.98647,"scheduling_latency_s":0.986516,"redis_calls":8,"redis_duration_s":0.004386,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050323,"completed_at":"2026-08-23T16:57:03.242Z","load_balancing_strategy":"primary","db_duration_s":0.002921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.516242] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6312b842f93d3b053c5fb04b","created_at":"2026-08-23T16:57:02.282Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.287Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6312b842f93d3b053c5fb04b: start","job_status":"start","queue_duration_s":0.957439,"scheduling_latency_s":0.957478} gitlab # [ 308.529998] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6312b842f93d3b053c5fb04b","created_at":"2026-08-23T16:57:02.282Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.287Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6312b842f93d3b053c5fb04b: done: 0.124954 sec","job_status":"done","queue_duration_s":0.957439,"scheduling_latency_s":0.957478,"redis_calls":60,"redis_duration_s":0.019796,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000935,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.017881,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.124954,"completed_at":"2026-08-23T16:57:03.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 308.578229] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"696267389abf1f5c7ac6533c","created_at":"2026-08-23T16:57:02.328Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c6a732cd088f3be5acb78c5ca132dbd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.348Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-696267389abf1f5c7ac6533c: start","job_status":"start","queue_duration_s":1.024043,"scheduling_latency_s":1.024071} gitlab # [ 308.998774] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.883Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"696267389abf1f5c7ac6533c","created_at":"2026-08-23T16:57:02.328Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c6a732cd088f3be5acb78c5ca132dbd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:57:02.348Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-696267389abf1f5c7ac6533c: done: 0.511731 sec","job_status":"done","queue_duration_s":1.024043,"scheduling_latency_s":1.024071,"redis_calls":562,"redis_duration_s":0.138307,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.136684,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.430027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.511731,"completed_at":"2026-08-23T16:57:03.883Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.090634] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a6682754fefb2fd52e8e235","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a6682754fefb2fd52e8e235: start","job_status":"start","queue_duration_s":0.524211,"scheduling_latency_s":0.524244} gitlab # [ 309.107646] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a6682754fefb2fd52e8e235","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a6682754fefb2fd52e8e235: done: 0.019541 sec","job_status":"done","queue_duration_s":0.524211,"scheduling_latency_s":0.524244,"redis_calls":13,"redis_duration_s":0.003231,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019541,"completed_at":"2026-08-23T16:57:03.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.152273] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5ee1d77fa14c152d3a48ae6","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5ee1d77fa14c152d3a48ae6: start","job_status":"start","queue_duration_s":0.545521,"scheduling_latency_s":0.545542} gitlab # [ 309.165907] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5ee1d77fa14c152d3a48ae6","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5ee1d77fa14c152d3a48ae6: done: 0.017113 sec","job_status":"done","queue_duration_s":0.545521,"scheduling_latency_s":0.545542,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017113,"completed_at":"2026-08-23T16:57:03.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.208972] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79070f72998f4a92001b07d8","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79070f72998f4a92001b07d8: start","job_status":"start","queue_duration_s":0.564271,"scheduling_latency_s":0.564291} gitlab # [ 309.223363] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79070f72998f4a92001b07d8","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79070f72998f4a92001b07d8: done: 0.017193 sec","job_status":"done","queue_duration_s":0.564271,"scheduling_latency_s":0.564291,"redis_calls":13,"redis_duration_s":0.00304,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017193,"completed_at":"2026-08-23T16:57:03.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.263876] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db8bdc480d7f8fe0bf422dfa","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db8bdc480d7f8fe0bf422dfa: start","job_status":"start","queue_duration_s":0.583123,"scheduling_latency_s":0.583144} gitlab # [ 309.277963] redis[794]: 10 changes in 300 seconds. Saving... gitlab # [ 309.279086] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db8bdc480d7f8fe0bf422dfa","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db8bdc480d7f8fe0bf422dfa: done: 0.017223 sec","job_status":"done","queue_duration_s":0.583123,"scheduling_latency_s":0.583144,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017223,"completed_at":"2026-08-23T16:57:03.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.321241] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"114882386bfdfd38743deff8","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-114882386bfdfd38743deff8: start","job_status":"start","queue_duration_s":0.602793,"scheduling_latency_s":0.602811} gitlab # [ 309.334134] redis[794]: Background saving started by pid 3441 gitlab # [ 309.335128] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"114882386bfdfd38743deff8","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-114882386bfdfd38743deff8: done: 0.017014 sec","job_status":"done","queue_duration_s":0.602793,"scheduling_latency_s":0.602811,"redis_calls":13,"redis_duration_s":0.0031379999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017014,"completed_at":"2026-08-23T16:57:03.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.375749] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:03.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad817b20e5c18b88b6070fcd","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad817b20e5c18b88b6070fcd: start","job_status":"start","queue_duration_s":0.622091,"scheduling_latency_s":0.622111} gitlab # [ 309.388781] redis[3441]: BGSAVE done, 473 keys saved, 0 keys skipped, 122962 bytes written. gitlab # [ 309.390105] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad817b20e5c18b88b6070fcd","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad817b20e5c18b88b6070fcd: done: 0.016823 sec","job_status":"done","queue_duration_s":0.622091,"scheduling_latency_s":0.622111,"redis_calls":13,"redis_duration_s":0.0028980000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016823,"completed_at":"2026-08-23T16:57:04.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.433876] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ce5a808237458a564fe694f","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ce5a808237458a564fe694f: start","job_status":"start","queue_duration_s":0.640582,"scheduling_latency_s":0.640601} gitlab # [ 309.447045] redis[3441]: DB saved on disk gitlab # [ 309.447827] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ce5a808237458a564fe694f","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ce5a808237458a564fe694f: done: 0.017238 sec","job_status":"done","queue_duration_s":0.640582,"scheduling_latency_s":0.640601,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017238,"completed_at":"2026-08-23T16:57:04.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.489425] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c20f0fa49f5870a56bf19e27","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c20f0fa49f5870a56bf19e27: start","job_status":"start","queue_duration_s":0.659312,"scheduling_latency_s":0.659327} gitlab # [ 309.502198] redis[3441]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB gitlab # [ 309.503348] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c20f0fa49f5870a56bf19e27","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c20f0fa49f5870a56bf19e27: done: 0.016966 sec","job_status":"done","queue_duration_s":0.659312,"scheduling_latency_s":0.659327,"redis_calls":13,"redis_duration_s":0.00343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016966,"completed_at":"2026-08-23T16:57:04.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.543364] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3997c0ba8b316573ec421b8","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3997c0ba8b316573ec421b8: start","job_status":"start","queue_duration_s":0.677899,"scheduling_latency_s":0.677917} gitlab # [ 309.556203] redis[794]: Background saving terminated with success gitlab # [ 309.557224] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3997c0ba8b316573ec421b8","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3997c0ba8b316573ec421b8: done: 0.017206 sec","job_status":"done","queue_duration_s":0.677899,"scheduling_latency_s":0.677917,"redis_calls":13,"redis_duration_s":0.003225,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017206,"completed_at":"2026-08-23T16:57:04.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.598711] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b5ccc711f4a399c9c7e003f","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b5ccc711f4a399c9c7e003f: start","job_status":"start","queue_duration_s":0.697916,"scheduling_latency_s":0.697936} gitlab # [ 309.611646] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b5ccc711f4a399c9c7e003f","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b5ccc711f4a399c9c7e003f: done: 0.017174 sec","job_status":"done","queue_duration_s":0.697916,"scheduling_latency_s":0.697936,"redis_calls":13,"redis_duration_s":0.0029969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017174,"completed_at":"2026-08-23T16:57:04.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.652386] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e28f368e9dd5ffeb55cb5adf","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e28f368e9dd5ffeb55cb5adf: start","job_status":"start","queue_duration_s":0.716664,"scheduling_latency_s":0.716685} gitlab # [ 309.664984] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e28f368e9dd5ffeb55cb5adf","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e28f368e9dd5ffeb55cb5adf: done: 0.028255 sec","job_status":"done","queue_duration_s":0.716664,"scheduling_latency_s":0.716685,"redis_calls":13,"redis_duration_s":0.010991,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028255,"completed_at":"2026-08-23T16:57:04.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.705146] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16f13be58aa57845e52395e3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16f13be58aa57845e52395e3: start","job_status":"start","queue_duration_s":0.746648,"scheduling_latency_s":0.746669} gitlab # [ 309.717853] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16f13be58aa57845e52395e3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16f13be58aa57845e52395e3: done: 0.017459 sec","job_status":"done","queue_duration_s":0.746648,"scheduling_latency_s":0.746669,"redis_calls":13,"redis_duration_s":0.0031720000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017459,"completed_at":"2026-08-23T16:57:04.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.757946] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b1fa17896bfac84f0ea010c","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b1fa17896bfac84f0ea010c: start","job_status":"start","queue_duration_s":0.766715,"scheduling_latency_s":0.766736} gitlab # [ 309.770268] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b1fa17896bfac84f0ea010c","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b1fa17896bfac84f0ea010c: done: 0.017304 sec","job_status":"done","queue_duration_s":0.766715,"scheduling_latency_s":0.766736,"redis_calls":13,"redis_duration_s":0.002992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017304,"completed_at":"2026-08-23T16:57:04.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.812406] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae0ed096ba0c1b5ff2226abe","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae0ed096ba0c1b5ff2226abe: start","job_status":"start","queue_duration_s":0.785689,"scheduling_latency_s":0.785709} gitlab # [ 309.825239] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae0ed096ba0c1b5ff2226abe","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae0ed096ba0c1b5ff2226abe: done: 0.017669 sec","job_status":"done","queue_duration_s":0.785689,"scheduling_latency_s":0.785709,"redis_calls":13,"redis_duration_s":0.003221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017669,"completed_at":"2026-08-23T16:57:04.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.868914] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e5bf05ae8f353d0a4f825a3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e5bf05ae8f353d0a4f825a3: start","job_status":"start","queue_duration_s":0.805104,"scheduling_latency_s":0.805125} gitlab # [ 309.881996] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e5bf05ae8f353d0a4f825a3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e5bf05ae8f353d0a4f825a3: done: 0.018111 sec","job_status":"done","queue_duration_s":0.805104,"scheduling_latency_s":0.805125,"redis_calls":13,"redis_duration_s":0.003222,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018111,"completed_at":"2026-08-23T16:57:04.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.924178] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8501d3171271e4d714cb61c3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8501d3171271e4d714cb61c3: start","job_status":"start","queue_duration_s":0.827101,"scheduling_latency_s":0.827124} gitlab # [ 309.937388] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8501d3171271e4d714cb61c3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8501d3171271e4d714cb61c3: done: 0.016776 sec","job_status":"done","queue_duration_s":0.827101,"scheduling_latency_s":0.827124,"redis_calls":13,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016776,"completed_at":"2026-08-23T16:57:04.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.979626] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae38c70eea0ff65f40dff01","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae38c70eea0ff65f40dff01: start","job_status":"start","queue_duration_s":0.845399,"scheduling_latency_s":0.845417} gitlab # [ 309.993275] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae38c70eea0ff65f40dff01","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae38c70eea0ff65f40dff01: done: 0.016178 sec","job_status":"done","queue_duration_s":0.845399,"scheduling_latency_s":0.845417,"redis_calls":13,"redis_duration_s":0.0028069999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016178,"completed_at":"2026-08-23T16:57:04.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.035830] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6faafab468a06b422a2f7c5","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6faafab468a06b422a2f7c5: start","job_status":"start","queue_duration_s":0.863115,"scheduling_latency_s":0.863132} gitlab # [ 310.048758] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6faafab468a06b422a2f7c5","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6faafab468a06b422a2f7c5: done: 0.017997 sec","job_status":"done","queue_duration_s":0.863115,"scheduling_latency_s":0.863132,"redis_calls":13,"redis_duration_s":0.003476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001325,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017997,"completed_at":"2026-08-23T16:57:04.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.088438] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84ec7a6b9cc1683581ae94e3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84ec7a6b9cc1683581ae94e3: start","job_status":"start","queue_duration_s":0.882621,"scheduling_latency_s":0.882638} gitlab # [ 310.100977] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84ec7a6b9cc1683581ae94e3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84ec7a6b9cc1683581ae94e3: done: 0.016146 sec","job_status":"done","queue_duration_s":0.882621,"scheduling_latency_s":0.882638,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016146,"completed_at":"2026-08-23T16:57:04.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.143085] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d789b9e9195f9b446d3a4d2d","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d789b9e9195f9b446d3a4d2d: start","job_status":"start","queue_duration_s":0.900268,"scheduling_latency_s":0.900287} gitlab # [ 310.156120] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d789b9e9195f9b446d3a4d2d","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d789b9e9195f9b446d3a4d2d: done: 0.016976 sec","job_status":"done","queue_duration_s":0.900268,"scheduling_latency_s":0.900287,"redis_calls":13,"redis_duration_s":0.002846,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016976,"completed_at":"2026-08-23T16:57:04.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.197598] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50dd32019c858f1ceb53134e","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50dd32019c858f1ceb53134e: start","job_status":"start","queue_duration_s":0.92003,"scheduling_latency_s":0.920051} gitlab # [ 310.212215] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50dd32019c858f1ceb53134e","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50dd32019c858f1ceb53134e: done: 0.018835 sec","job_status":"done","queue_duration_s":0.92003,"scheduling_latency_s":0.920051,"redis_calls":13,"redis_duration_s":0.005012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003312,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018835,"completed_at":"2026-08-23T16:57:04.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.253563] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6e99758719168995331be40","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6e99758719168995331be40: start","job_status":"start","queue_duration_s":0.94045,"scheduling_latency_s":0.940474} gitlab # [ 310.266891] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6e99758719168995331be40","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6e99758719168995331be40: done: 0.017901 sec","job_status":"done","queue_duration_s":0.94045,"scheduling_latency_s":0.940474,"redis_calls":13,"redis_duration_s":0.003171,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017901,"completed_at":"2026-08-23T16:57:04.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.309055] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f36c3abb31f1ba4f2a9455b","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f36c3abb31f1ba4f2a9455b: start","job_status":"start","queue_duration_s":0.959878,"scheduling_latency_s":0.959898} gitlab # [ 310.322375] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f36c3abb31f1ba4f2a9455b","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f36c3abb31f1ba4f2a9455b: done: 0.01848 sec","job_status":"done","queue_duration_s":0.959878,"scheduling_latency_s":0.959898,"redis_calls":13,"redis_duration_s":0.002996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01848,"completed_at":"2026-08-23T16:57:04.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.363136] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18edf3758320cb54692e7387","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18edf3758320cb54692e7387: start","job_status":"start","queue_duration_s":0.979949,"scheduling_latency_s":0.980001} gitlab # [ 310.376640] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18edf3758320cb54692e7387","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18edf3758320cb54692e7387: done: 0.017949 sec","job_status":"done","queue_duration_s":0.979949,"scheduling_latency_s":0.980001,"redis_calls":13,"redis_duration_s":0.004524,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003491,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017949,"completed_at":"2026-08-23T16:57:04.359Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.420233] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba3ff8f949f2d19d94c4a5d0","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba3ff8f949f2d19d94c4a5d0: start","job_status":"start","queue_duration_s":0.999493,"scheduling_latency_s":0.999512} gitlab # [ 310.434427] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba3ff8f949f2d19d94c4a5d0","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba3ff8f949f2d19d94c4a5d0: done: 0.016434 sec","job_status":"done","queue_duration_s":0.999493,"scheduling_latency_s":0.999512,"redis_calls":13,"redis_duration_s":0.002932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016434,"completed_at":"2026-08-23T16:57:04.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.479309] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b85cefcf79ba8b6d16deb310","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b85cefcf79ba8b6d16deb310: start","job_status":"start","queue_duration_s":1.01743,"scheduling_latency_s":1.017447} gitlab # [ 310.493701] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b85cefcf79ba8b6d16deb310","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b85cefcf79ba8b6d16deb310: done: 0.016855 sec","job_status":"done","queue_duration_s":1.01743,"scheduling_latency_s":1.017447,"redis_calls":13,"redis_duration_s":0.003433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016855,"completed_at":"2026-08-23T16:57:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.536610] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2211547f9cb7ccd13b64a248","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2211547f9cb7ccd13b64a248: start","job_status":"start","queue_duration_s":1.036508,"scheduling_latency_s":1.036525} gitlab # [ 310.550463] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2211547f9cb7ccd13b64a248","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2211547f9cb7ccd13b64a248: done: 0.015719 sec","job_status":"done","queue_duration_s":1.036508,"scheduling_latency_s":1.036525,"redis_calls":13,"redis_duration_s":0.002901,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015719,"completed_at":"2026-08-23T16:57:04.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.592925] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4294eee2f0ef57f3666e4c84","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4294eee2f0ef57f3666e4c84: start","job_status":"start","queue_duration_s":1.053701,"scheduling_latency_s":1.05372} gitlab # [ 310.607968] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4294eee2f0ef57f3666e4c84","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4294eee2f0ef57f3666e4c84: done: 0.016287 sec","job_status":"done","queue_duration_s":1.053701,"scheduling_latency_s":1.05372,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016287,"completed_at":"2026-08-23T16:57:04.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.655042] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e0ae98b8230eca947e42dc4","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e0ae98b8230eca947e42dc4: start","job_status":"start","queue_duration_s":1.071554,"scheduling_latency_s":1.071574} gitlab # [ 310.693674] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e0ae98b8230eca947e42dc4","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e0ae98b8230eca947e42dc4: done: 0.016986 sec","job_status":"done","queue_duration_s":1.071554,"scheduling_latency_s":1.071574,"redis_calls":13,"redis_duration_s":0.003185,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016986,"completed_at":"2026-08-23T16:57:04.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.780364] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13618c4c672f367c746e9ea3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13618c4c672f367c746e9ea3: start","job_status":"start","queue_duration_s":1.090146,"scheduling_latency_s":1.090164} gitlab # [ 310.801710] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13618c4c672f367c746e9ea3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13618c4c672f367c746e9ea3: done: 0.017246 sec","job_status":"done","queue_duration_s":1.090146,"scheduling_latency_s":1.090164,"redis_calls":13,"redis_duration_s":0.003316,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017246,"completed_at":"2026-08-23T16:57:04.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.859692] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01911b42c6ee34a6921456c4","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01911b42c6ee34a6921456c4: start","job_status":"start","queue_duration_s":1.114278,"scheduling_latency_s":1.114302} gitlab # [ 310.875755] postgres[861]: [861] LOG: checkpoint starting: time gitlab # [ 310.876975] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01911b42c6ee34a6921456c4","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01911b42c6ee34a6921456c4: done: 0.025176 sec","job_status":"done","queue_duration_s":1.114278,"scheduling_latency_s":1.114302,"redis_calls":13,"redis_duration_s":0.008562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025176,"completed_at":"2026-08-23T16:57:04.501Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.918762] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e87cbbb8b379d96943cc5086","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e87cbbb8b379d96943cc5086: start","job_status":"start","queue_duration_s":1.141479,"scheduling_latency_s":1.141501} gitlab # [ 310.931597] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e87cbbb8b379d96943cc5086","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e87cbbb8b379d96943cc5086: done: 0.020389 sec","job_status":"done","queue_duration_s":1.141479,"scheduling_latency_s":1.141501,"redis_calls":13,"redis_duration_s":0.005719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020389,"completed_at":"2026-08-23T16:57:04.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 310.973256] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cbf919e2a267f67d66f4eeb","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cbf919e2a267f67d66f4eeb: start","job_status":"start","queue_duration_s":1.165666,"scheduling_latency_s":1.165688} gitlab # [ 310.986518] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cbf919e2a267f67d66f4eeb","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cbf919e2a267f67d66f4eeb: done: 0.018759 sec","job_status":"done","queue_duration_s":1.165666,"scheduling_latency_s":1.165688,"redis_calls":13,"redis_duration_s":0.003464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002316,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018759,"completed_at":"2026-08-23T16:57:04.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.027063] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6b1239facbdc0a9cb88b6be","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6b1239facbdc0a9cb88b6be: start","job_status":"start","queue_duration_s":1.186148,"scheduling_latency_s":1.186169} gitlab # [ 311.041190] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6b1239facbdc0a9cb88b6be","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6b1239facbdc0a9cb88b6be: done: 0.017476 sec","job_status":"done","queue_duration_s":1.186148,"scheduling_latency_s":1.186169,"redis_calls":13,"redis_duration_s":0.0032639999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017476,"completed_at":"2026-08-23T16:57:04.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.082562] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70f1c1b45c607cfa4925cfe2","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70f1c1b45c607cfa4925cfe2: start","job_status":"start","queue_duration_s":1.205953,"scheduling_latency_s":1.205974} gitlab # [ 311.095872] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70f1c1b45c607cfa4925cfe2","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70f1c1b45c607cfa4925cfe2: done: 0.017927 sec","job_status":"done","queue_duration_s":1.205953,"scheduling_latency_s":1.205974,"redis_calls":13,"redis_duration_s":0.003439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00228,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017927,"completed_at":"2026-08-23T16:57:04.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.137385] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60814fcc97ff654f08cae1c6","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60814fcc97ff654f08cae1c6: start","job_status":"start","queue_duration_s":1.225628,"scheduling_latency_s":1.22565} gitlab # [ 311.151175] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60814fcc97ff654f08cae1c6","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60814fcc97ff654f08cae1c6: done: 0.017217 sec","job_status":"done","queue_duration_s":1.225628,"scheduling_latency_s":1.22565,"redis_calls":13,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017217,"completed_at":"2026-08-23T16:57:04.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.197228] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b71eec97ec5494eceba083c","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b71eec97ec5494eceba083c: start","job_status":"start","queue_duration_s":1.244459,"scheduling_latency_s":1.24448} gitlab # [ 311.211769] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b71eec97ec5494eceba083c","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b71eec97ec5494eceba083c: done: 0.016555 sec","job_status":"done","queue_duration_s":1.244459,"scheduling_latency_s":1.24448,"redis_calls":13,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016555,"completed_at":"2026-08-23T16:57:04.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.258913] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce56196aca3dc1689e3abfed","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce56196aca3dc1689e3abfed: start","job_status":"start","queue_duration_s":1.262638,"scheduling_latency_s":1.262657} gitlab # [ 311.272306] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce56196aca3dc1689e3abfed","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce56196aca3dc1689e3abfed: done: 0.016735 sec","job_status":"done","queue_duration_s":1.262638,"scheduling_latency_s":1.262657,"redis_calls":13,"redis_duration_s":0.00295,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016735,"completed_at":"2026-08-23T16:57:04.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.315646] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b55cfd97e08dfabe603b2ab","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b55cfd97e08dfabe603b2ab: start","job_status":"start","queue_duration_s":1.281051,"scheduling_latency_s":1.281073} gitlab # [ 311.329177] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b55cfd97e08dfabe603b2ab","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b55cfd97e08dfabe603b2ab: done: 0.017216 sec","job_status":"done","queue_duration_s":1.281051,"scheduling_latency_s":1.281073,"redis_calls":13,"redis_duration_s":0.0031219999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017216,"completed_at":"2026-08-23T16:57:04.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.373097] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"625b3ebabd2675a67b4757b3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-625b3ebabd2675a67b4757b3: start","job_status":"start","queue_duration_s":1.300048,"scheduling_latency_s":1.30007} gitlab # [ 311.386665] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"625b3ebabd2675a67b4757b3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-625b3ebabd2675a67b4757b3: done: 0.018293 sec","job_status":"done","queue_duration_s":1.300048,"scheduling_latency_s":1.30007,"redis_calls":13,"redis_duration_s":0.0032189999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018293,"completed_at":"2026-08-23T16:57:04.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.428337] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39b15c10daedb454fab1b10a","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39b15c10daedb454fab1b10a: start","job_status":"start","queue_duration_s":1.320049,"scheduling_latency_s":1.320069} gitlab # [ 311.443159] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39b15c10daedb454fab1b10a","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39b15c10daedb454fab1b10a: done: 0.019056 sec","job_status":"done","queue_duration_s":1.320049,"scheduling_latency_s":1.320069,"redis_calls":13,"redis_duration_s":0.004118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001131,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019056,"completed_at":"2026-08-23T16:57:04.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.486893] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58f606cb2cb6fcf0c7cad359","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58f606cb2cb6fcf0c7cad359: start","job_status":"start","queue_duration_s":1.340902,"scheduling_latency_s":1.340925} gitlab # [ 311.501730] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58f606cb2cb6fcf0c7cad359","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58f606cb2cb6fcf0c7cad359: done: 0.031051 sec","job_status":"done","queue_duration_s":1.340902,"scheduling_latency_s":1.340925,"redis_calls":13,"redis_duration_s":0.014351,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031051,"completed_at":"2026-08-23T16:57:04.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.547392] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1109c822c3fbbe1585f07ba","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1109c822c3fbbe1585f07ba: start","job_status":"start","queue_duration_s":1.374567,"scheduling_latency_s":1.3746} gitlab # [ 311.560912] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1109c822c3fbbe1585f07ba","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1109c822c3fbbe1585f07ba: done: 0.019771 sec","job_status":"done","queue_duration_s":1.374567,"scheduling_latency_s":1.3746,"redis_calls":13,"redis_duration_s":0.003554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002378,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019771,"completed_at":"2026-08-23T16:57:04.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.601053] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfd6134f6dde5d4a0938b357","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfd6134f6dde5d4a0938b357: start","job_status":"start","queue_duration_s":1.396892,"scheduling_latency_s":1.396919} gitlab # [ 311.614355] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfd6134f6dde5d4a0938b357","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfd6134f6dde5d4a0938b357: done: 0.02119 sec","job_status":"done","queue_duration_s":1.396892,"scheduling_latency_s":1.396919,"redis_calls":13,"redis_duration_s":0.0037549999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002502,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02119,"completed_at":"2026-08-23T16:57:04.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.656173] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"226cc6507bc6e29885e29c78","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-226cc6507bc6e29885e29c78: start","job_status":"start","queue_duration_s":1.420111,"scheduling_latency_s":1.420142} gitlab # [ 311.668636] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"226cc6507bc6e29885e29c78","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-226cc6507bc6e29885e29c78: done: 0.02154 sec","job_status":"done","queue_duration_s":1.420111,"scheduling_latency_s":1.420142,"redis_calls":13,"redis_duration_s":0.004305,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00309,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02154,"completed_at":"2026-08-23T16:57:04.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.708379] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"447aad86419a71ad44e0a0b3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-447aad86419a71ad44e0a0b3: start","job_status":"start","queue_duration_s":1.4437,"scheduling_latency_s":1.443728} gitlab # [ 311.720768] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"447aad86419a71ad44e0a0b3","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-447aad86419a71ad44e0a0b3: done: 0.021623 sec","job_status":"done","queue_duration_s":1.4437,"scheduling_latency_s":1.443728,"redis_calls":13,"redis_duration_s":0.004468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00308,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021623,"completed_at":"2026-08-23T16:57:04.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.760594] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a7ebbac5624483bec97b19e","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a7ebbac5624483bec97b19e: start","job_status":"start","queue_duration_s":1.467312,"scheduling_latency_s":1.46734} gitlab # [ 311.773005] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a7ebbac5624483bec97b19e","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a7ebbac5624483bec97b19e: done: 0.020642 sec","job_status":"done","queue_duration_s":1.467312,"scheduling_latency_s":1.46734,"redis_calls":13,"redis_duration_s":0.0034319999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020642,"completed_at":"2026-08-23T16:57:04.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.812832] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a51ac3065005569ed064b6","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a51ac3065005569ed064b6: start","job_status":"start","queue_duration_s":1.489987,"scheduling_latency_s":1.490017} gitlab # [ 311.825199] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a51ac3065005569ed064b6","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a51ac3065005569ed064b6: done: 0.020842 sec","job_status":"done","queue_duration_s":1.489987,"scheduling_latency_s":1.490017,"redis_calls":13,"redis_duration_s":0.004109,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020842,"completed_at":"2026-08-23T16:57:04.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.866699] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9192c9df9d09dc9481dfa32","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9192c9df9d09dc9481dfa32: start","job_status":"start","queue_duration_s":1.512988,"scheduling_latency_s":1.513015} gitlab # [ 311.880072] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9192c9df9d09dc9481dfa32","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9192c9df9d09dc9481dfa32: done: 0.021209 sec","job_status":"done","queue_duration_s":1.512988,"scheduling_latency_s":1.513015,"redis_calls":13,"redis_duration_s":0.004838,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021209,"completed_at":"2026-08-23T16:57:04.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.921565] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82aea1a09e06921f9993667f","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82aea1a09e06921f9993667f: start","job_status":"start","queue_duration_s":1.536291,"scheduling_latency_s":1.536318} gitlab # [ 311.934840] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:57:04.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82aea1a09e06921f9993667f","created_at":"2026-08-23T16:57:03.262Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-7410acb25909480e","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f88217f1612b8b8f40de3e401f28c885","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:57:03.361Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82aea1a09e06921f9993667f: done: 0.019965 sec","job_status":"done","queue_duration_s":1.536291,"scheduling_latency_s":1.536318,"redis_calls":13,"redis_duration_s":0.0036179999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002362,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019965,"completed_at":"2026-08-23T16:57:04.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.778295] gitaly[924]: time="2026-08-23T16:57:07.662Z" level=info msg="burden monitor stats" pid=924 gitlab # [ 324.181426] setup-gitlab-start[3269]: W, [2026-08-23T16:57:19.065591 #3269] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 371.367457] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"8201cd8b6f2f2c758dcb1874","created_at":"2026-08-23T16:58:06.162Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fea035aebdbf13994c1969a369e7646c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.246Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-8201cd8b6f2f2c758dcb1874: start","job_status":"start","queue_duration_s":0.004619,"scheduling_latency_s":0.004677} gitlab # [ 371.565688] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.450Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"8201cd8b6f2f2c758dcb1874","created_at":"2026-08-23T16:58:06.162Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fea035aebdbf13994c1969a369e7646c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.246Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-8201cd8b6f2f2c758dcb1874: done: 0.199162 sec","job_status":"done","queue_duration_s":0.004619,"scheduling_latency_s":0.004677,"redis_calls":18,"redis_duration_s":0.074006,"redis_read_bytes":1034,"redis_write_bytes":1341,"redis_cache_calls":3,"redis_cache_duration_s":0.010869,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.046176,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":548,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006826,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.199162,"completed_at":"2026-08-23T16:58:06.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 371.656225] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"146c1aee34cd675fa3c89c77","created_at":"2026-08-23T16:58:06.276Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6861a7382e623eb289f11706cd510eea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.286Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-146c1aee34cd675fa3c89c77: start","job_status":"start","queue_duration_s":0.180138,"scheduling_latency_s":0.180208} gitlab # [ 371.730388] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"146c1aee34cd675fa3c89c77","created_at":"2026-08-23T16:58:06.276Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6861a7382e623eb289f11706cd510eea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.286Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-146c1aee34cd675fa3c89c77: done: 0.148988 sec","job_status":"done","queue_duration_s":0.180138,"scheduling_latency_s":0.180208,"redis_calls":10,"redis_duration_s":0.015677,"redis_read_bytes":389,"redis_write_bytes":1014,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001779,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":238,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004157,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.148988,"completed_at":"2026-08-23T16:58:06.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 371.775627] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"189cf91e4533a4d83a16afa4","created_at":"2026-08-23T16:58:06.342Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e465866bd5e23d5f075b2376f239bbb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.358Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-189cf91e4533a4d83a16afa4: start","job_status":"start","queue_duration_s":0.286112,"scheduling_latency_s":0.28618} gitlab # [ 371.984237] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"189cf91e4533a4d83a16afa4","created_at":"2026-08-23T16:58:06.342Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e465866bd5e23d5f075b2376f239bbb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.358Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-189cf91e4533a4d83a16afa4: done: 0.219782 sec","job_status":"done","queue_duration_s":0.286112,"scheduling_latency_s":0.28618,"redis_calls":8,"redis_duration_s":0.054171000000000004,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.038322,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00777,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.219782,"completed_at":"2026-08-23T16:58:06.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.058378] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:06.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8c5aadffcab312fd1b584a5b","created_at":"2026-08-23T16:58:06.384Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b65b6970597a5979159f45ce09e528b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.404Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8c5aadffcab312fd1b584a5b: start","job_status":"start","queue_duration_s":0.481934,"scheduling_latency_s":0.481998} gitlab # [ 372.162556] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.046Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"8c5aadffcab312fd1b584a5b","created_at":"2026-08-23T16:58:06.384Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b65b6970597a5979159f45ce09e528b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.404Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-8c5aadffcab312fd1b584a5b: done: 0.160331 sec","job_status":"done","queue_duration_s":0.481934,"scheduling_latency_s":0.481998,"redis_calls":10,"redis_duration_s":0.029990000000000003,"redis_read_bytes":265,"redis_write_bytes":941,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004852,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.020063,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":540,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005075,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.160331,"completed_at":"2026-08-23T16:58:07.046Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.246154] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4ab87d0c3330fcd694bec5b8","created_at":"2026-08-23T16:58:06.435Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.443Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4ab87d0c3330fcd694bec5b8: start","job_status":"start","queue_duration_s":0.660384,"scheduling_latency_s":0.660448} gitlab # [ 372.499823] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4ab87d0c3330fcd694bec5b8","created_at":"2026-08-23T16:58:06.435Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.443Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4ab87d0c3330fcd694bec5b8: done: 0.278972 sec","job_status":"done","queue_duration_s":0.660384,"scheduling_latency_s":0.660448,"redis_calls":16,"redis_duration_s":0.060064,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.01235,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.001962,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.032316,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.013436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.278972,"completed_at":"2026-08-23T16:58:07.382Z","load_balancing_strategy":"primary","db_duration_s":0.00539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.591576] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"53228cf4dda5ab508da0502b","created_at":"2026-08-23T16:58:06.469Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347c0dcc8dbd4083e671bbb2ba0acee7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.479Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-53228cf4dda5ab508da0502b: start","job_status":"start","queue_duration_s":0.908817,"scheduling_latency_s":0.908872} gitlab # [ 372.610963] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.430Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 372.615554] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"53228cf4dda5ab508da0502b","created_at":"2026-08-23T16:58:06.469Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347c0dcc8dbd4083e671bbb2ba0acee7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.479Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-53228cf4dda5ab508da0502b: done: 0.056168 sec","job_status":"done","queue_duration_s":0.908817,"scheduling_latency_s":0.908872,"redis_calls":8,"redis_duration_s":0.004916,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000426,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056168,"completed_at":"2026-08-23T16:58:07.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.665031] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b6bf7759179b2e8906bf0406","created_at":"2026-08-23T16:58:06.521Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13748ed8e8c78752d8784ff3f494eac8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.548Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b6bf7759179b2e8906bf0406: start","job_status":"start","queue_duration_s":0.901493,"scheduling_latency_s":0.901546} gitlab # [ 372.709946] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b6bf7759179b2e8906bf0406","created_at":"2026-08-23T16:58:06.521Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13748ed8e8c78752d8784ff3f494eac8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.548Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b6bf7759179b2e8906bf0406: done: 0.056627 sec","job_status":"done","queue_duration_s":0.901493,"scheduling_latency_s":0.901546,"redis_calls":11,"redis_duration_s":0.006017,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000393,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003243,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002381,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0127609,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.056627,"completed_at":"2026-08-23T16:58:07.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004175,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 372.790340] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"32b3679123f9607436a46cdd","created_at":"2026-08-23T16:58:06.579Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"858050f9beb45a486bf670896c900cbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:58:06.592Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-32b3679123f9607436a46cdd: start","job_status":"start","queue_duration_s":0.916903,"scheduling_latency_s":0.916949} gitlab # [ 372.807474] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.530Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 372.812336] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"32b3679123f9607436a46cdd","created_at":"2026-08-23T16:58:06.579Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"858050f9beb45a486bf670896c900cbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T16:58:06.592Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-32b3679123f9607436a46cdd: done: 0.032343 sec","job_status":"done","queue_duration_s":0.916903,"scheduling_latency_s":0.916949,"redis_calls":8,"redis_duration_s":0.004263,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000354,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032343,"completed_at":"2026-08-23T16:58:07.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.861160] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"26dd5adb51ec450808e042c9","created_at":"2026-08-23T16:58:06.612Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"badfc199df480ab6fe8df417684b4dce","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.626Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-26dd5adb51ec450808e042c9: start","job_status":"start","queue_duration_s":0.918218,"scheduling_latency_s":0.918263} gitlab # [ 372.875257] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"26dd5adb51ec450808e042c9","created_at":"2026-08-23T16:58:06.612Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"badfc199df480ab6fe8df417684b4dce","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.626Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-26dd5adb51ec450808e042c9: done: 0.030612 sec","job_status":"done","queue_duration_s":0.918218,"scheduling_latency_s":0.918263,"redis_calls":8,"redis_duration_s":0.0037080000000000004,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000219,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030612,"completed_at":"2026-08-23T16:58:07.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.920226] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"458647cc04011d06ecf56dd2","created_at":"2026-08-23T16:58:06.647Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe3e56da009a42877ff9529620bfde6e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.657Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-458647cc04011d06ecf56dd2: start","job_status":"start","queue_duration_s":0.919673,"scheduling_latency_s":0.919713} gitlab # [ 372.936439] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"458647cc04011d06ecf56dd2","created_at":"2026-08-23T16:58:06.647Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe3e56da009a42877ff9529620bfde6e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.657Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-458647cc04011d06ecf56dd2: done: 0.046927 sec","job_status":"done","queue_duration_s":0.919673,"scheduling_latency_s":0.919713,"redis_calls":8,"redis_duration_s":0.0035510000000000003,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.046927,"completed_at":"2026-08-23T16:58:07.624Z","load_balancing_strategy":"primary","db_duration_s":0.002696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.982723] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"bb20fbf79686347ca6ec9cad","created_at":"2026-08-23T16:58:06.673Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f81254e6e224a3b7857203d2caf45c7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.683Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-bb20fbf79686347ca6ec9cad: start","job_status":"start","queue_duration_s":0.946229,"scheduling_latency_s":0.946279} gitlab # [ 372.999101] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.674Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"bb20fbf79686347ca6ec9cad","created_at":"2026-08-23T16:58:06.673Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f81254e6e224a3b7857203d2caf45c7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.683Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-bb20fbf79686347ca6ec9cad: done: 0.043753 sec","job_status":"done","queue_duration_s":0.946229,"scheduling_latency_s":0.946279,"redis_calls":11,"redis_duration_s":0.003443,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001064,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043753,"completed_at":"2026-08-23T16:58:07.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.047455] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8107efd6b41901421ee7ad02","created_at":"2026-08-23T16:58:06.717Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a146362211c626de080ad3f8bfff5873","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.723Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8107efd6b41901421ee7ad02: start","job_status":"start","queue_duration_s":0.953033,"scheduling_latency_s":0.953073} gitlab # [ 373.063356] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8107efd6b41901421ee7ad02","created_at":"2026-08-23T16:58:06.717Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a146362211c626de080ad3f8bfff5873","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.723Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8107efd6b41901421ee7ad02: done: 0.027277 sec","job_status":"done","queue_duration_s":0.953033,"scheduling_latency_s":0.953073,"redis_calls":10,"redis_duration_s":0.004456,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002911,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008229,"exclusive_lock_hold_duration_s":0.003657,"duration_s":0.027277,"completed_at":"2026-08-23T16:58:07.703Z","load_balancing_strategy":"primary","db_duration_s":0.000772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.108392] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2729643fbe42e252c700b7d9","created_at":"2026-08-23T16:58:06.729Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b1f11c0836316abca23fffe9bbb0682","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.734Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2729643fbe42e252c700b7d9: start","job_status":"start","queue_duration_s":0.971086,"scheduling_latency_s":0.971113} gitlab # [ 373.123219] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.719Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 373.127241] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2729643fbe42e252c700b7d9","created_at":"2026-08-23T16:58:06.729Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b1f11c0836316abca23fffe9bbb0682","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.734Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2729643fbe42e252c700b7d9: done: 0.035524 sec","job_status":"done","queue_duration_s":0.971086,"scheduling_latency_s":0.971113,"redis_calls":8,"redis_duration_s":0.00598,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000173,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035524,"completed_at":"2026-08-23T16:58:07.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.170224] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7bcc0f6cf1a96228dc94eeb6","created_at":"2026-08-23T16:58:06.805Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ba652e332b131fa75ddda9435cc3dbb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.822Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7bcc0f6cf1a96228dc94eeb6: start","job_status":"start","queue_duration_s":0.921483,"scheduling_latency_s":0.921524} gitlab # [ 373.185066] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.758Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 373.188399] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7bcc0f6cf1a96228dc94eeb6","created_at":"2026-08-23T16:58:06.805Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ba652e332b131fa75ddda9435cc3dbb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.822Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7bcc0f6cf1a96228dc94eeb6: done: 0.02482 sec","job_status":"done","queue_duration_s":0.921483,"scheduling_latency_s":0.921524,"redis_calls":8,"redis_duration_s":0.002238,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02482,"completed_at":"2026-08-23T16:58:07.768Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.232630] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"58ca079d127cd4a788a96cc8","created_at":"2026-08-23T16:58:06.867Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30164f696a1fc2054d78fc8c247e4235","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.885Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-58ca079d127cd4a788a96cc8: start","job_status":"start","queue_duration_s":0.885417,"scheduling_latency_s":0.885454} gitlab # [ 373.249376] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"58ca079d127cd4a788a96cc8","created_at":"2026-08-23T16:58:06.867Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30164f696a1fc2054d78fc8c247e4235","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.885Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-58ca079d127cd4a788a96cc8: done: 0.028885 sec","job_status":"done","queue_duration_s":0.885417,"scheduling_latency_s":0.885454,"redis_calls":10,"redis_duration_s":0.003225,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00090792,"exclusive_lock_hold_duration_s":0.00432864,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028885,"completed_at":"2026-08-23T16:58:07.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.293730] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"74686ad25ea707374db9f4a9","created_at":"2026-08-23T16:58:06.926Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e74211406c3f5192fd9c086a2abcec67","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.959Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-74686ad25ea707374db9f4a9: start","job_status":"start","queue_duration_s":0.842068,"scheduling_latency_s":0.842102} gitlab # [ 373.310145] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.830Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"74686ad25ea707374db9f4a9","created_at":"2026-08-23T16:58:06.926Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e74211406c3f5192fd9c086a2abcec67","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:06.959Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-74686ad25ea707374db9f4a9: done: 0.02904 sec","job_status":"done","queue_duration_s":0.842068,"scheduling_latency_s":0.842102,"redis_calls":10,"redis_duration_s":0.002886,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00094008,"exclusive_lock_hold_duration_s":0.00443838,"duration_s":0.02904,"completed_at":"2026-08-23T16:58:07.830Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.354689] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2b1224712b49a65214fab15d","created_at":"2026-08-23T16:58:06.981Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b2d9ed713349aac356e8d1829d0f061","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.001Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2b1224712b49a65214fab15d: start","job_status":"start","queue_duration_s":0.831765,"scheduling_latency_s":0.831793} gitlab # [ 373.370250] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2b1224712b49a65214fab15d","created_at":"2026-08-23T16:58:06.981Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b2d9ed713349aac356e8d1829d0f061","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.001Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2b1224712b49a65214fab15d: done: 0.080508 sec","job_status":"done","queue_duration_s":0.831765,"scheduling_latency_s":0.831793,"redis_calls":11,"redis_duration_s":0.005948,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002442,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008559,"exclusive_lock_hold_duration_s":0.0513393,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.080508,"completed_at":"2026-08-23T16:58:07.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.419113] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cff50ca3aa778aa27b9ee88a","created_at":"2026-08-23T16:58:07.023Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04fe83b4f428e6507614b1d5f80475b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.040Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cff50ca3aa778aa27b9ee88a: start","job_status":"start","queue_duration_s":0.877343,"scheduling_latency_s":0.877392} gitlab # [ 373.459597] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.937Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 373.466355] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cff50ca3aa778aa27b9ee88a","created_at":"2026-08-23T16:58:07.023Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04fe83b4f428e6507614b1d5f80475b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.040Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cff50ca3aa778aa27b9ee88a: done: 0.033461 sec","job_status":"done","queue_duration_s":0.877343,"scheduling_latency_s":0.877392,"redis_calls":8,"redis_duration_s":0.0033799999999999998,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033461,"completed_at":"2026-08-23T16:58:07.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.526359] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"16f2347fffa4682fac07b442","created_at":"2026-08-23T16:58:07.067Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da359ad43c101594ee05e83d9a22b793","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:58:07.082Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-16f2347fffa4682fac07b442: start","job_status":"start","queue_duration_s":0.874028,"scheduling_latency_s":0.874087} gitlab # [ 373.542414] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.977Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 373.546450] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"16f2347fffa4682fac07b442","created_at":"2026-08-23T16:58:07.067Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da359ad43c101594ee05e83d9a22b793","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T16:58:07.082Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-16f2347fffa4682fac07b442: done: 0.034288 sec","job_status":"done","queue_duration_s":0.874028,"scheduling_latency_s":0.874087,"redis_calls":8,"redis_duration_s":0.003026,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034288,"completed_at":"2026-08-23T16:58:07.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.591310] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:07.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"540c13cb81eef4b61acb33e3","created_at":"2026-08-23T16:58:07.102Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"901e7abdf08c0e613f51c906dfecc1d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.118Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-540c13cb81eef4b61acb33e3: start","job_status":"start","queue_duration_s":0.874109,"scheduling_latency_s":0.87415} gitlab # [ 373.605733] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"540c13cb81eef4b61acb33e3","created_at":"2026-08-23T16:58:07.102Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"901e7abdf08c0e613f51c906dfecc1d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.118Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-540c13cb81eef4b61acb33e3: done: 0.430565 sec","job_status":"done","queue_duration_s":0.874109,"scheduling_latency_s":0.87415,"redis_calls":11,"redis_duration_s":0.003597,"redis_read_bytes":263,"redis_write_bytes":1140,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":153,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":129,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.31459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00105942,"exclusive_lock_hold_duration_s":0.40133692,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.430565,"completed_at":"2026-08-23T16:58:08.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.137918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.650746] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1f9519df94d87e60bf7932f1","created_at":"2026-08-23T16:58:07.140Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50deee135d50b304f1b84517d908eafb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.165Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1f9519df94d87e60bf7932f1: start","job_status":"start","queue_duration_s":1.261407,"scheduling_latency_s":1.261442} gitlab # [ 373.666249] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1f9519df94d87e60bf7932f1","created_at":"2026-08-23T16:58:07.140Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50deee135d50b304f1b84517d908eafb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.165Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1f9519df94d87e60bf7932f1: done: 0.063018 sec","job_status":"done","queue_duration_s":1.261407,"scheduling_latency_s":1.261442,"redis_calls":10,"redis_duration_s":0.003554,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00022,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00098438,"exclusive_lock_hold_duration_s":0.028611,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.063018,"completed_at":"2026-08-23T16:58:08.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.711259] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"536c028eb32926c1e08a0f8b","created_at":"2026-08-23T16:58:07.198Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b671c4d6f4d84d820a5006efc5facd66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:58:07.209Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-536c028eb32926c1e08a0f8b: start","job_status":"start","queue_duration_s":1.282909,"scheduling_latency_s":1.282954} gitlab # [ 373.725851] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"536c028eb32926c1e08a0f8b","created_at":"2026-08-23T16:58:07.198Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b671c4d6f4d84d820a5006efc5facd66","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T16:58:07.209Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-536c028eb32926c1e08a0f8b: done: 0.038937 sec","job_status":"done","queue_duration_s":1.282909,"scheduling_latency_s":1.282954,"redis_calls":8,"redis_duration_s":0.002488,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000227,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038937,"completed_at":"2026-08-23T16:58:08.531Z","load_balancing_strategy":"primary","db_duration_s":0.002942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.766983] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8387e9f2f280e1502e045c2e","created_at":"2026-08-23T16:58:07.296Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.323Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8387e9f2f280e1502e045c2e: start","job_status":"start","queue_duration_s":1.210844,"scheduling_latency_s":1.210882} gitlab # [ 373.837377] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8387e9f2f280e1502e045c2e","created_at":"2026-08-23T16:58:07.296Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.323Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8387e9f2f280e1502e045c2e: done: 0.188413 sec","job_status":"done","queue_duration_s":1.210844,"scheduling_latency_s":1.210882,"redis_calls":65,"redis_duration_s":0.02256,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001157,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.00106,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.019208,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.188413,"completed_at":"2026-08-23T16:58:08.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.884185] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.724Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1f79c8f1c2da436cf0033f51","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1f79c8f1c2da436cf0033f51: start","job_status":"start","queue_duration_s":1.399817,"scheduling_latency_s":1.39986} gitlab # [ 373.897284] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.762Z","message":"No existing merge request to be cleaned up."} gitlab # [ 373.899554] postgres[3679]: [3679] ERROR: relation "table_without_models" does not exist gitlab # [ 373.900897] postgres[3679]: [3679] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 373.902306] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.775Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1f79c8f1c2da436cf0033f51","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1f79c8f1c2da436cf0033f51: done: 0.050589 sec","job_status":"done","queue_duration_s":1.399817,"scheduling_latency_s":1.39986,"redis_calls":11,"redis_duration_s":0.003113,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000173,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050589,"completed_at":"2026-08-23T16:58:08.775Z","load_balancing_strategy":"primary","db_duration_s":0.00241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 373.946246] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.777Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa20b2b117dad6071ef1647c","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa20b2b117dad6071ef1647c: start","job_status":"start","queue_duration_s":1.451992,"scheduling_latency_s":1.452027} gitlab # [ 373.959675] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.792Z","message":"No existing merge request to be cleaned up."} gitlab # [ 373.961628] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.805Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa20b2b117dad6071ef1647c","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa20b2b117dad6071ef1647c: done: 0.028503 sec","job_status":"done","queue_duration_s":1.451992,"scheduling_latency_s":1.452027,"redis_calls":10,"redis_duration_s":0.002836,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028503,"completed_at":"2026-08-23T16:58:08.805Z","load_balancing_strategy":"primary","db_duration_s":0.00246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.001578] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.807Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"120eebff6560e55ea0f2b0c5","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-120eebff6560e55ea0f2b0c5: start","job_status":"start","queue_duration_s":1.482485,"scheduling_latency_s":1.482518} gitlab # [ 374.014761] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.821Z","message":"No existing merge request to be cleaned up."} gitlab # [ 374.016602] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.833Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"120eebff6560e55ea0f2b0c5","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-120eebff6560e55ea0f2b0c5: done: 0.025801 sec","job_status":"done","queue_duration_s":1.482485,"scheduling_latency_s":1.482518,"redis_calls":10,"redis_duration_s":0.002124,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025801,"completed_at":"2026-08-23T16:58:08.833Z","load_balancing_strategy":"primary","db_duration_s":0.002277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.058103] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.835Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce53ac3de88d9e4d8b406910","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce53ac3de88d9e4d8b406910: start","job_status":"start","queue_duration_s":1.510418,"scheduling_latency_s":1.510453} gitlab # [ 374.071273] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.849Z","message":"No existing merge request to be cleaned up."} gitlab # [ 374.073290] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.862Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce53ac3de88d9e4d8b406910","created_at":"2026-08-23T16:58:07.207Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-cf1f33bec6f9443f","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7c9a642c17cd7a85a01ac15279fa991d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.325Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce53ac3de88d9e4d8b406910: done: 0.026808 sec","job_status":"done","queue_duration_s":1.510418,"scheduling_latency_s":1.510453,"redis_calls":10,"redis_duration_s":0.0022040000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026808,"completed_at":"2026-08-23T16:58:08.862Z","load_balancing_strategy":"primary","db_duration_s":0.002391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.117014] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:08.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1722d8691ead9aafb94a9772","created_at":"2026-08-23T16:58:07.355Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92d27a69382d2223f45da5af9e3a0f00","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.372Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1722d8691ead9aafb94a9772: start","job_status":"start","queue_duration_s":1.491587,"scheduling_latency_s":1.491619} gitlab # [ 374.389476] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1722d8691ead9aafb94a9772","created_at":"2026-08-23T16:58:07.355Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-b79588141a97497c","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92d27a69382d2223f45da5af9e3a0f00","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:07.372Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1722d8691ead9aafb94a9772: done: 0.410748 sec","job_status":"done","queue_duration_s":1.491587,"scheduling_latency_s":1.491619,"redis_calls":563,"redis_duration_s":0.116821,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000198,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.115465,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.342593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.410748,"completed_at":"2026-08-23T16:58:09.274Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.486690] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e349d682a226b8e670d44f5a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e349d682a226b8e670d44f5a: start","job_status":"start","queue_duration_s":0.567673,"scheduling_latency_s":0.567704} gitlab # [ 374.502593] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e349d682a226b8e670d44f5a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e349d682a226b8e670d44f5a: done: 0.01996 sec","job_status":"done","queue_duration_s":0.567673,"scheduling_latency_s":0.567704,"redis_calls":14,"redis_duration_s":0.003594,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01996,"completed_at":"2026-08-23T16:58:09.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.547733] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a1c1ce94cd00921ef31e1b2","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a1c1ce94cd00921ef31e1b2: start","job_status":"start","queue_duration_s":0.589509,"scheduling_latency_s":0.589539} gitlab # [ 374.562404] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a1c1ce94cd00921ef31e1b2","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a1c1ce94cd00921ef31e1b2: done: 0.018622 sec","job_status":"done","queue_duration_s":0.589509,"scheduling_latency_s":0.589539,"redis_calls":13,"redis_duration_s":0.0031980000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018622,"completed_at":"2026-08-23T16:58:09.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.604747] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be9cc730291fc0a1dd826cfa","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be9cc730291fc0a1dd826cfa: start","job_status":"start","queue_duration_s":0.609971,"scheduling_latency_s":0.610001} gitlab # [ 374.617968] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be9cc730291fc0a1dd826cfa","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be9cc730291fc0a1dd826cfa: done: 0.01861 sec","job_status":"done","queue_duration_s":0.609971,"scheduling_latency_s":0.610001,"redis_calls":13,"redis_duration_s":0.003175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01861,"completed_at":"2026-08-23T16:58:09.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.659223] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"146906d87b89488dd2cdc768","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-146906d87b89488dd2cdc768: start","job_status":"start","queue_duration_s":0.63123,"scheduling_latency_s":0.631262} gitlab # [ 374.672547] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"146906d87b89488dd2cdc768","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-146906d87b89488dd2cdc768: done: 0.018953 sec","job_status":"done","queue_duration_s":0.63123,"scheduling_latency_s":0.631262,"redis_calls":13,"redis_duration_s":0.003196,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018953,"completed_at":"2026-08-23T16:58:09.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.713519] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0488c015a01871656ff06ca","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0488c015a01871656ff06ca: start","job_status":"start","queue_duration_s":0.65197,"scheduling_latency_s":0.651998} gitlab # [ 374.726834] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0488c015a01871656ff06ca","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0488c015a01871656ff06ca: done: 0.019429 sec","job_status":"done","queue_duration_s":0.65197,"scheduling_latency_s":0.651998,"redis_calls":13,"redis_duration_s":0.002828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019429,"completed_at":"2026-08-23T16:58:09.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.769680] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"409df65d4c8e9ad2140246e6","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-409df65d4c8e9ad2140246e6: start","job_status":"start","queue_duration_s":0.673203,"scheduling_latency_s":0.673234} gitlab # [ 374.782929] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"409df65d4c8e9ad2140246e6","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-409df65d4c8e9ad2140246e6: done: 0.018648 sec","job_status":"done","queue_duration_s":0.673203,"scheduling_latency_s":0.673234,"redis_calls":13,"redis_duration_s":0.0021260000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018648,"completed_at":"2026-08-23T16:58:09.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.824385] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a584520c65a182c73466a09","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a584520c65a182c73466a09: start","job_status":"start","queue_duration_s":0.693622,"scheduling_latency_s":0.693651} gitlab # [ 374.862846] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a584520c65a182c73466a09","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a584520c65a182c73466a09: done: 0.01894 sec","job_status":"done","queue_duration_s":0.693622,"scheduling_latency_s":0.693651,"redis_calls":13,"redis_duration_s":0.002273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01894,"completed_at":"2026-08-23T16:58:09.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 374.941841] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"097be12a9026d2e5d39e2313","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-097be12a9026d2e5d39e2313: start","job_status":"start","queue_duration_s":0.71427,"scheduling_latency_s":0.714302} gitlab # [ 374.957198] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"097be12a9026d2e5d39e2313","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-097be12a9026d2e5d39e2313: done: 0.019402 sec","job_status":"done","queue_duration_s":0.71427,"scheduling_latency_s":0.714302,"redis_calls":13,"redis_duration_s":0.002548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019402,"completed_at":"2026-08-23T16:58:09.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.002518] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"068d5068f54a518a2a201712","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-068d5068f54a518a2a201712: start","job_status":"start","queue_duration_s":0.735364,"scheduling_latency_s":0.735395} gitlab # [ 375.016585] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"068d5068f54a518a2a201712","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-068d5068f54a518a2a201712: done: 0.019122 sec","job_status":"done","queue_duration_s":0.735364,"scheduling_latency_s":0.735395,"redis_calls":13,"redis_duration_s":0.002474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001611,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019122,"completed_at":"2026-08-23T16:58:09.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.057095] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db07af6ae4bb41b5809b6a40","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db07af6ae4bb41b5809b6a40: start","job_status":"start","queue_duration_s":0.756107,"scheduling_latency_s":0.756135} gitlab # [ 375.070082] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db07af6ae4bb41b5809b6a40","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db07af6ae4bb41b5809b6a40: done: 0.018917 sec","job_status":"done","queue_duration_s":0.756107,"scheduling_latency_s":0.756135,"redis_calls":13,"redis_duration_s":0.002189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018917,"completed_at":"2026-08-23T16:58:09.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.110338] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476c444057eede4e115d2566","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476c444057eede4e115d2566: start","job_status":"start","queue_duration_s":0.776703,"scheduling_latency_s":0.776733} gitlab # [ 375.122833] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476c444057eede4e115d2566","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476c444057eede4e115d2566: done: 0.018994 sec","job_status":"done","queue_duration_s":0.776703,"scheduling_latency_s":0.776733,"redis_calls":13,"redis_duration_s":0.002247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018994,"completed_at":"2026-08-23T16:58:09.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.163408] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6f401c782954546e7b023ee","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6f401c782954546e7b023ee: start","job_status":"start","queue_duration_s":0.797515,"scheduling_latency_s":0.797546} gitlab # [ 375.176115] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6f401c782954546e7b023ee","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6f401c782954546e7b023ee: done: 0.018911 sec","job_status":"done","queue_duration_s":0.797515,"scheduling_latency_s":0.797546,"redis_calls":13,"redis_duration_s":0.002308,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018911,"completed_at":"2026-08-23T16:58:09.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.215221] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c71326b3426b1daad18b43a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c71326b3426b1daad18b43a: start","job_status":"start","queue_duration_s":0.818212,"scheduling_latency_s":0.818241} gitlab # [ 375.227848] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c71326b3426b1daad18b43a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c71326b3426b1daad18b43a: done: 0.019075 sec","job_status":"done","queue_duration_s":0.818212,"scheduling_latency_s":0.818241,"redis_calls":13,"redis_duration_s":0.002179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019075,"completed_at":"2026-08-23T16:58:09.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.267299] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf729b0d8e7391b8a1d1dcb3","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf729b0d8e7391b8a1d1dcb3: start","job_status":"start","queue_duration_s":0.838884,"scheduling_latency_s":0.838914} gitlab # [ 375.279876] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf729b0d8e7391b8a1d1dcb3","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf729b0d8e7391b8a1d1dcb3: done: 0.018468 sec","job_status":"done","queue_duration_s":0.838884,"scheduling_latency_s":0.838914,"redis_calls":13,"redis_duration_s":0.0021200000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001373,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018468,"completed_at":"2026-08-23T16:58:09.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.319569] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd19206286004e9a262cad08","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd19206286004e9a262cad08: start","job_status":"start","queue_duration_s":0.858722,"scheduling_latency_s":0.858747} gitlab # [ 375.332273] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd19206286004e9a262cad08","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd19206286004e9a262cad08: done: 0.015517 sec","job_status":"done","queue_duration_s":0.858722,"scheduling_latency_s":0.858747,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015517,"completed_at":"2026-08-23T16:58:09.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.372880] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a70b20a4acc06f120d66e15","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a70b20a4acc06f120d66e15: start","job_status":"start","queue_duration_s":0.875572,"scheduling_latency_s":0.875595} gitlab # [ 375.385217] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a70b20a4acc06f120d66e15","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a70b20a4acc06f120d66e15: done: 0.016101 sec","job_status":"done","queue_duration_s":0.875572,"scheduling_latency_s":0.875595,"redis_calls":13,"redis_duration_s":0.001749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016101,"completed_at":"2026-08-23T16:58:09.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.424295] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"225e4a9a3fccfa6c57d238e4","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-225e4a9a3fccfa6c57d238e4: start","job_status":"start","queue_duration_s":0.893189,"scheduling_latency_s":0.893216} gitlab # [ 375.436608] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"225e4a9a3fccfa6c57d238e4","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-225e4a9a3fccfa6c57d238e4: done: 0.016942 sec","job_status":"done","queue_duration_s":0.893189,"scheduling_latency_s":0.893216,"redis_calls":13,"redis_duration_s":0.001831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016942,"completed_at":"2026-08-23T16:58:09.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.476602] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97d01bb35ac10e3356bbcd86","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97d01bb35ac10e3356bbcd86: start","job_status":"start","queue_duration_s":0.911532,"scheduling_latency_s":0.911557} gitlab # [ 375.489030] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97d01bb35ac10e3356bbcd86","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97d01bb35ac10e3356bbcd86: done: 0.016935 sec","job_status":"done","queue_duration_s":0.911532,"scheduling_latency_s":0.911557,"redis_calls":13,"redis_duration_s":0.001953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016935,"completed_at":"2026-08-23T16:58:09.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.529188] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"260bbc6616d7fa660320a865","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-260bbc6616d7fa660320a865: start","job_status":"start","queue_duration_s":0.929972,"scheduling_latency_s":0.929998} gitlab # [ 375.541586] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"260bbc6616d7fa660320a865","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-260bbc6616d7fa660320a865: done: 0.017532 sec","job_status":"done","queue_duration_s":0.929972,"scheduling_latency_s":0.929998,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017532,"completed_at":"2026-08-23T16:58:09.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.582140] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"549322d40d547a7c3b23db76","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-549322d40d547a7c3b23db76: start","job_status":"start","queue_duration_s":0.94904,"scheduling_latency_s":0.94912} gitlab # [ 375.594692] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"549322d40d547a7c3b23db76","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-549322d40d547a7c3b23db76: done: 0.017698 sec","job_status":"done","queue_duration_s":0.94904,"scheduling_latency_s":0.94912,"redis_calls":13,"redis_duration_s":0.001916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017698,"completed_at":"2026-08-23T16:58:09.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.633909] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74ebfad544892ad51509c081","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74ebfad544892ad51509c081: start","job_status":"start","queue_duration_s":0.968245,"scheduling_latency_s":0.968273} gitlab # [ 375.646355] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74ebfad544892ad51509c081","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74ebfad544892ad51509c081: done: 0.017985 sec","job_status":"done","queue_duration_s":0.968245,"scheduling_latency_s":0.968273,"redis_calls":13,"redis_duration_s":0.00183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017985,"completed_at":"2026-08-23T16:58:09.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.685289] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb14aba6bedf8d2566d86308","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb14aba6bedf8d2566d86308: start","job_status":"start","queue_duration_s":0.987947,"scheduling_latency_s":0.987975} gitlab # [ 375.697659] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb14aba6bedf8d2566d86308","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb14aba6bedf8d2566d86308: done: 0.018059 sec","job_status":"done","queue_duration_s":0.987947,"scheduling_latency_s":0.987975,"redis_calls":13,"redis_duration_s":0.001914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018059,"completed_at":"2026-08-23T16:58:09.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.736619] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d95755af5bc9bd78a9b4081","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d95755af5bc9bd78a9b4081: start","job_status":"start","queue_duration_s":1.007563,"scheduling_latency_s":1.007591} gitlab # [ 375.748973] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d95755af5bc9bd78a9b4081","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d95755af5bc9bd78a9b4081: done: 0.020488 sec","job_status":"done","queue_duration_s":1.007563,"scheduling_latency_s":1.007591,"redis_calls":13,"redis_duration_s":0.002367,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020488,"completed_at":"2026-08-23T16:58:09.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.789080] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f61743af9cf4eaa39f8c7fc6","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f61743af9cf4eaa39f8c7fc6: start","job_status":"start","queue_duration_s":1.02972,"scheduling_latency_s":1.029747} gitlab # [ 375.801421] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f61743af9cf4eaa39f8c7fc6","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f61743af9cf4eaa39f8c7fc6: done: 0.018661 sec","job_status":"done","queue_duration_s":1.02972,"scheduling_latency_s":1.029747,"redis_calls":13,"redis_duration_s":0.0020829999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018661,"completed_at":"2026-08-23T16:58:09.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.840548] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30215dec5131da9045381edc","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30215dec5131da9045381edc: start","job_status":"start","queue_duration_s":1.050078,"scheduling_latency_s":1.050107} gitlab # [ 375.852868] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30215dec5131da9045381edc","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30215dec5131da9045381edc: done: 0.017836 sec","job_status":"done","queue_duration_s":1.050078,"scheduling_latency_s":1.050107,"redis_calls":13,"redis_duration_s":0.002006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017836,"completed_at":"2026-08-23T16:58:09.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.892304] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5040dcf7c7b5da12473750","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5040dcf7c7b5da12473750: start","job_status":"start","queue_duration_s":1.069631,"scheduling_latency_s":1.069661} gitlab # [ 375.904591] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5040dcf7c7b5da12473750","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5040dcf7c7b5da12473750: done: 0.017993 sec","job_status":"done","queue_duration_s":1.069631,"scheduling_latency_s":1.069661,"redis_calls":13,"redis_duration_s":0.002038,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001313,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017993,"completed_at":"2026-08-23T16:58:09.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.943893] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"199ac0fe1c32079d4e1f798b","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-199ac0fe1c32079d4e1f798b: start","job_status":"start","queue_duration_s":1.089312,"scheduling_latency_s":1.089342} gitlab # [ 375.956536] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"199ac0fe1c32079d4e1f798b","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-199ac0fe1c32079d4e1f798b: done: 0.017972 sec","job_status":"done","queue_duration_s":1.089312,"scheduling_latency_s":1.089342,"redis_calls":13,"redis_duration_s":0.001948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017972,"completed_at":"2026-08-23T16:58:09.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 375.998856] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01a9a0254c8a68417fa50029","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01a9a0254c8a68417fa50029: start","job_status":"start","queue_duration_s":1.108834,"scheduling_latency_s":1.108861} gitlab # [ 376.011579] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01a9a0254c8a68417fa50029","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01a9a0254c8a68417fa50029: done: 0.017833 sec","job_status":"done","queue_duration_s":1.108834,"scheduling_latency_s":1.108861,"redis_calls":13,"redis_duration_s":0.001904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017833,"completed_at":"2026-08-23T16:58:09.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.051020] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e67fffe8e0f8dc7ff8dee051","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e67fffe8e0f8dc7ff8dee051: start","job_status":"start","queue_duration_s":1.128217,"scheduling_latency_s":1.128245} gitlab # [ 376.063594] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e67fffe8e0f8dc7ff8dee051","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e67fffe8e0f8dc7ff8dee051: done: 0.017641 sec","job_status":"done","queue_duration_s":1.128217,"scheduling_latency_s":1.128245,"redis_calls":13,"redis_duration_s":0.001772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017641,"completed_at":"2026-08-23T16:58:09.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.102988] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91cbe3c39e313ffc957f3d7b","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91cbe3c39e313ffc957f3d7b: start","job_status":"start","queue_duration_s":1.147309,"scheduling_latency_s":1.147337} gitlab # [ 376.115334] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91cbe3c39e313ffc957f3d7b","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91cbe3c39e313ffc957f3d7b: done: 0.017773 sec","job_status":"done","queue_duration_s":1.147309,"scheduling_latency_s":1.147337,"redis_calls":13,"redis_duration_s":0.001948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017773,"completed_at":"2026-08-23T16:58:09.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.154608] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fff56fb039ee0344f2bd2b2","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fff56fb039ee0344f2bd2b2: start","job_status":"start","queue_duration_s":1.166593,"scheduling_latency_s":1.166618} gitlab # [ 376.167114] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fff56fb039ee0344f2bd2b2","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fff56fb039ee0344f2bd2b2: done: 0.015719 sec","job_status":"done","queue_duration_s":1.166593,"scheduling_latency_s":1.166618,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015719,"completed_at":"2026-08-23T16:58:09.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.207796] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0f7847a93938d2178885e46","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0f7847a93938d2178885e46: start","job_status":"start","queue_duration_s":1.183669,"scheduling_latency_s":1.183694} gitlab # [ 376.220542] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0f7847a93938d2178885e46","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0f7847a93938d2178885e46: done: 0.016267 sec","job_status":"done","queue_duration_s":1.183669,"scheduling_latency_s":1.183694,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016267,"completed_at":"2026-08-23T16:58:09.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.259721] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b06634d267b42fe610f1869","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b06634d267b42fe610f1869: start","job_status":"start","queue_duration_s":1.201469,"scheduling_latency_s":1.201495} gitlab # [ 376.272350] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b06634d267b42fe610f1869","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b06634d267b42fe610f1869: done: 0.017305 sec","job_status":"done","queue_duration_s":1.201469,"scheduling_latency_s":1.201495,"redis_calls":13,"redis_duration_s":0.0018180000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017305,"completed_at":"2026-08-23T16:58:09.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.311779] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b3d369a7c958555135296f2","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b3d369a7c958555135296f2: start","job_status":"start","queue_duration_s":1.220281,"scheduling_latency_s":1.220308} gitlab # [ 376.324483] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b3d369a7c958555135296f2","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b3d369a7c958555135296f2: done: 0.01779 sec","job_status":"done","queue_duration_s":1.220281,"scheduling_latency_s":1.220308,"redis_calls":13,"redis_duration_s":0.002231,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01779,"completed_at":"2026-08-23T16:58:09.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.363553] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"454ed74619eb7fe74cc5b78c","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-454ed74619eb7fe74cc5b78c: start","job_status":"start","queue_duration_s":1.239613,"scheduling_latency_s":1.239639} gitlab # [ 376.376148] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"454ed74619eb7fe74cc5b78c","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-454ed74619eb7fe74cc5b78c: done: 0.017446 sec","job_status":"done","queue_duration_s":1.239613,"scheduling_latency_s":1.239639,"redis_calls":13,"redis_duration_s":0.001978,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017446,"completed_at":"2026-08-23T16:58:09.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.416485] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aea49fc5551620713a9acef5","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aea49fc5551620713a9acef5: start","job_status":"start","queue_duration_s":1.258668,"scheduling_latency_s":1.258696} gitlab # [ 376.428820] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aea49fc5551620713a9acef5","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aea49fc5551620713a9acef5: done: 0.017439 sec","job_status":"done","queue_duration_s":1.258668,"scheduling_latency_s":1.258696,"redis_calls":13,"redis_duration_s":0.001997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017439,"completed_at":"2026-08-23T16:58:09.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.468478] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:09.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"897e0fee1f9a70e369462b14","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-897e0fee1f9a70e369462b14: start","job_status":"start","queue_duration_s":1.277835,"scheduling_latency_s":1.277863} gitlab # [ 376.480785] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"897e0fee1f9a70e369462b14","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-897e0fee1f9a70e369462b14: done: 0.017561 sec","job_status":"done","queue_duration_s":1.277835,"scheduling_latency_s":1.277863,"redis_calls":13,"redis_duration_s":0.002012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017561,"completed_at":"2026-08-23T16:58:10.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.519930] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d02381f91f9d63562cd9188","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d02381f91f9d63562cd9188: start","job_status":"start","queue_duration_s":1.296912,"scheduling_latency_s":1.296975} gitlab # [ 376.532606] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d02381f91f9d63562cd9188","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d02381f91f9d63562cd9188: done: 0.017699 sec","job_status":"done","queue_duration_s":1.296912,"scheduling_latency_s":1.296975,"redis_calls":13,"redis_duration_s":0.0018679999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017699,"completed_at":"2026-08-23T16:58:10.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.571975] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b75246491187e0727d71dc43","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b75246491187e0727d71dc43: start","job_status":"start","queue_duration_s":1.316181,"scheduling_latency_s":1.316209} gitlab # [ 376.585101] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b75246491187e0727d71dc43","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b75246491187e0727d71dc43: done: 0.017788 sec","job_status":"done","queue_duration_s":1.316181,"scheduling_latency_s":1.316209,"redis_calls":13,"redis_duration_s":0.001903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017788,"completed_at":"2026-08-23T16:58:10.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.625367] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9252ad1cea185c2c4228b64a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9252ad1cea185c2c4228b64a: start","job_status":"start","queue_duration_s":1.335864,"scheduling_latency_s":1.335891} gitlab # [ 376.637801] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9252ad1cea185c2c4228b64a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9252ad1cea185c2c4228b64a: done: 0.036093 sec","job_status":"done","queue_duration_s":1.335864,"scheduling_latency_s":1.335891,"redis_calls":13,"redis_duration_s":0.002162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036093,"completed_at":"2026-08-23T16:58:10.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.676753] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fdba815bd0f243e5f3bf045","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fdba815bd0f243e5f3bf045: start","job_status":"start","queue_duration_s":1.374555,"scheduling_latency_s":1.374589} gitlab # [ 376.689088] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1fdba815bd0f243e5f3bf045","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1fdba815bd0f243e5f3bf045: done: 0.022921 sec","job_status":"done","queue_duration_s":1.374555,"scheduling_latency_s":1.374589,"redis_calls":13,"redis_duration_s":0.003653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00244,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022921,"completed_at":"2026-08-23T16:58:10.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.728451] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c41422df158b16980f0edfb","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c41422df158b16980f0edfb: start","job_status":"start","queue_duration_s":1.39973,"scheduling_latency_s":1.399766} gitlab # [ 376.740690] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c41422df158b16980f0edfb","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c41422df158b16980f0edfb: done: 0.025663 sec","job_status":"done","queue_duration_s":1.39973,"scheduling_latency_s":1.399766,"redis_calls":13,"redis_duration_s":0.003865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002503,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025663,"completed_at":"2026-08-23T16:58:10.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.779897] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"016d5e5e759cfe1f58eeeb68","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-016d5e5e759cfe1f58eeeb68: start","job_status":"start","queue_duration_s":1.427576,"scheduling_latency_s":1.427608} gitlab # [ 376.794388] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"016d5e5e759cfe1f58eeeb68","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-016d5e5e759cfe1f58eeeb68: done: 0.025992 sec","job_status":"done","queue_duration_s":1.427576,"scheduling_latency_s":1.427608,"redis_calls":13,"redis_duration_s":0.0038980000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002605,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025992,"completed_at":"2026-08-23T16:58:10.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.835789] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c24ac3f016887f48a79ec6f","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c24ac3f016887f48a79ec6f: start","job_status":"start","queue_duration_s":1.457597,"scheduling_latency_s":1.457634} gitlab # [ 376.849175] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c24ac3f016887f48a79ec6f","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c24ac3f016887f48a79ec6f: done: 0.025953 sec","job_status":"done","queue_duration_s":1.457597,"scheduling_latency_s":1.457634,"redis_calls":13,"redis_duration_s":0.0038589999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002485,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025953,"completed_at":"2026-08-23T16:58:10.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.890691] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8319451648c08455be4005f","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8319451648c08455be4005f: start","job_status":"start","queue_duration_s":1.485935,"scheduling_latency_s":1.485975} gitlab # [ 376.904044] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8319451648c08455be4005f","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8319451648c08455be4005f: done: 0.025868 sec","job_status":"done","queue_duration_s":1.485935,"scheduling_latency_s":1.485975,"redis_calls":13,"redis_duration_s":0.004070000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025868,"completed_at":"2026-08-23T16:58:10.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.943391] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"271c855ae24e12faf86f2f3c","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-271c855ae24e12faf86f2f3c: start","job_status":"start","queue_duration_s":1.514034,"scheduling_latency_s":1.514071} gitlab # [ 376.955959] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"271c855ae24e12faf86f2f3c","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-271c855ae24e12faf86f2f3c: done: 0.024999 sec","job_status":"done","queue_duration_s":1.514034,"scheduling_latency_s":1.514071,"redis_calls":13,"redis_duration_s":0.0036290000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024999,"completed_at":"2026-08-23T16:58:10.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 376.996249] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aab8d715c6fdfbaed485950b","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aab8d715c6fdfbaed485950b: start","job_status":"start","queue_duration_s":1.541287,"scheduling_latency_s":1.541323} gitlab # [ 377.009769] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aab8d715c6fdfbaed485950b","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aab8d715c6fdfbaed485950b: done: 0.026768 sec","job_status":"done","queue_duration_s":1.541287,"scheduling_latency_s":1.541323,"redis_calls":13,"redis_duration_s":0.00366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026768,"completed_at":"2026-08-23T16:58:10.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 377.048691] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fffd6b41421fca1a7ac9f8a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fffd6b41421fca1a7ac9f8a: start","job_status":"start","queue_duration_s":1.570349,"scheduling_latency_s":1.570385} gitlab # [ 377.061059] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fffd6b41421fca1a7ac9f8a","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fffd6b41421fca1a7ac9f8a: done: 0.02535 sec","job_status":"done","queue_duration_s":1.570349,"scheduling_latency_s":1.570385,"redis_calls":13,"redis_duration_s":0.003724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02535,"completed_at":"2026-08-23T16:58:10.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 377.100297] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9456935d5da5915f52e8282e","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9456935d5da5915f52e8282e: start","job_status":"start","queue_duration_s":1.597875,"scheduling_latency_s":1.59791} gitlab # [ 377.112535] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9456935d5da5915f52e8282e","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9456935d5da5915f52e8282e: done: 0.02666 sec","job_status":"done","queue_duration_s":1.597875,"scheduling_latency_s":1.59791,"redis_calls":13,"redis_duration_s":0.004403000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02666,"completed_at":"2026-08-23T16:58:10.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 377.151470] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77e7ff646f12d4a47ee878a3","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77e7ff646f12d4a47ee878a3: start","job_status":"start","queue_duration_s":1.626802,"scheduling_latency_s":1.626839} gitlab # [ 377.164023] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:10.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77e7ff646f12d4a47ee878a3","created_at":"2026-08-23T16:58:08.554Z","trace_propagation_headers":{"sentry-trace":"17aa2e6f990b4672a49089498d03f9fa-29cffb05079d4bb1","baggage":"sentry-trace_id=17aa2e6f990b4672a49089498d03f9fa,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"212ebe2286a74de7f862c3b74fc56f0f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:08.708Z","job_size_bytes":2,"pid":2080,"sidekiq_tid":"m7oc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77e7ff646f12d4a47ee878a3: done: 0.026619 sec","job_status":"done","queue_duration_s":1.626802,"scheduling_latency_s":1.626839,"redis_calls":13,"redis_duration_s":0.004489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026619,"completed_at":"2026-08-23T16:58:10.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 380.368854] runuser[3268]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 380.370817] setup-gitlab-start[3241]: + systemctl restart gitlab-sidekiq.service gitlab # [ 380.408750] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 380.410333] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:15.294Z","message":"Shutting down"} gitlab # [ 380.412512] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:15.297Z","message":"Scheduler exiting..."} gitlab # [ 380.417086] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:15.299Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 380.422362] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:15.300Z","message":"Scheduler exiting..."} gitlab # [ 380.919783] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:15.805Z","message":"Bye!"} gitlab # [ 380.966337] sidekiq-cluster[2080]: {"severity":"INFO","time":"2026-08-23T16:58:15.851Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2080,"worker_id":"sidekiq_0","memwd_rss_bytes":920780800,"retry":0} gitlab # [ 381.518516] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 381.520971] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 381.522670] systemd[1]: gitlab-sidekiq.service: Consumed 2min 32.833s CPU time over 4min 13.566s wall clock time, 935M memory peak, 4.4M read from disk. gitlab # [ 381.530256] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 381.535634] setup-gitlab-start[3241]: + mkdir -p /var/lib/secrets gitlab # [ 381.541840] setup-gitlab-start[3241]: + echo nixbot-test-token-of-20-chars gitlab # [ 381.544426] setup-gitlab-start[3241]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 381.548840] setup-gitlab-start[3241]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 383.760167] gitaly[924]: time="2026-08-23T16:58:18.644Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:28.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:18.643" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 383.760551] gitaly[924]: time="2026-08-23T16:58:18.644Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:28.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:18.643" grpc.time_ms=0.894 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.037365] gitaly[924]: time="2026-08-23T16:58:18.922Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:28.281" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:18.922" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.053778] gitaly[924]: time="2026-08-23T16:58:18.923Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:28.281" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:18.922" grpc.time_ms=0.58 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.118043] gitaly[924]: time="2026-08-23T16:58:19.003Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM diskcache=8c9a1002-218b-4764-bf28-34298a377bb3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:58:28.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:18.942" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.133325] gitaly[924]: time="2026-08-23T16:58:19.004Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=32 command.real_time_ms=34 command.spawn_token_fork_ms=4 command.system_time_ms=20 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:58:28.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:18.942" grpc.time_ms=61.885 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.152089] gitaly[924]: time="2026-08-23T16:58:19.037Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.035" pid=924 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 384.164162] gitaly[924]: time="2026-08-23T16:58:19.038Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.035" grpc.time_ms=2.154 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.183560] gitaly[924]: time="2026-08-23T16:58:19.069Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:58:29.020" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.052" grpc.time_ms=16.619 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.376545] gitaly[924]: time="2026-08-23T16:58:19.261Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.230" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.261" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.409497] gitaly[924]: time="2026-08-23T16:58:19.262Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.230" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.261" grpc.time_ms=0.831 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.459922] gitaly[924]: time="2026-08-23T16:58:19.345Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM diskcache=77186610-0f6e-40fd-bdd3-9da1b7de187c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:58:29.238" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.269" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.490259] gitaly[924]: time="2026-08-23T16:58:19.346Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=51 command.spawn_token_fork_ms=6 command.system_time_ms=43 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T16:58:29.238" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.269" grpc.time_ms=76.761 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.515634] gitaly[924]: time="2026-08-23T16:58:19.363Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.361" pid=924 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 384.530955] gitaly[924]: time="2026-08-23T16:58:19.363Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.361" grpc.time_ms=1.606 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.545353] gitaly[924]: time="2026-08-23T16:58:19.393Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:58:29.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.372" grpc.time_ms=19.776 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.590684] gitaly[924]: time="2026-08-23T16:58:19.476Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T16:58:29.124" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.475" grpc.time_ms=0.353 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 384.616315] gitaly[924]: time="2026-08-23T16:58:19.495Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T16:58:29.143" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:19.494" grpc.time_ms=0.652 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 385.446644] gitaly[924]: time="2026-08-23T16:58:20.331Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY0GKFGEA72BKXV9D62CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:58:30.279" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:20.311" grpc.time_ms=20.068 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 385.970053] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:20 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 4387 gitlab # [ 385.974818] setup-gitlab-start[3241]: + mkdir -p /tmp/test-flake gitlab # [ 385.980958] setup-gitlab-start[3241]: + cd /tmp/test-flake gitlab # [ 385.981884] setup-gitlab-start[3241]: + git init -b master gitlab # [ 386.023764] setup-gitlab-start[3794]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 386.025868] setup-gitlab-start[3241]: + git config user.name test gitlab # [ 386.033051] setup-gitlab-start[3241]: + git config user.email test@example.com gitlab # [ 386.041622] setup-gitlab-start[3241]: + cat gitlab # [ 386.048718] setup-gitlab-start[3241]: + git add flake.nix gitlab # [ 386.058632] setup-gitlab-start[3241]: + git commit -m 'initial commit' gitlab # [ 386.102483] setup-gitlab-start[3799]: [master (root-commit) a8bdad1] initial commit gitlab # [ 386.108143] setup-gitlab-start[3799]: 1 file changed, 10 insertions(+) gitlab # [ 386.110962] setup-gitlab-start[3799]: create mode 100644 flake.nix gitlab # [ 386.113755] setup-gitlab-start[3241]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 386.120643] setup-gitlab-start[3241]: + git push -u origin master gitlab # [ 386.540757] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 363 gitlab # [ 386.991510] gitaly[924]: time="2026-08-23T16:58:21.875Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5BSR6APT61GAJ7FZZ3X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:21.857" grpc.time_ms=18.407 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 387.035334] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:21 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 442 gitlab # [ 387.464186] gitaly[924]: time="2026-08-23T16:58:22.349Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:58:32.296" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:22.327" grpc.time_ms=21.954 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.569722] gitaly[924]: time="2026-08-23T16:58:22.455Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T16:58:52.033" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T16:58:22.433" grpc.time_ms=21.398 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.626706] gitaly[924]: time="2026-08-23T16:58:22.510Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S duration_ms=354ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 387.843919] gitaly[924]: time="2026-08-23T16:58:22.728Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S duration_ms=216ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 387.858695] gitaly[924]: time="2026-08-23T16:58:22.729Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:22.154" grpc.time_ms=574.369 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 387.948512] gitaly[924]: time="2026-08-23T16:58:22.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:22.831" grpc.time_ms=1.622 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 388.031292] gitaly[924]: time="2026-08-23T16:58:22.915Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:22.914" grpc.time_ms=1.228 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 388.089580] gitaly[924]: time="2026-08-23T16:58:22.975Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:22.973" grpc.time_ms=1.219 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 388.406998] gitaly[924]: time="2026-08-23T16:58:23.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T16:58:33.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:23.279" grpc.time_ms=12.353 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 388.462174] gitaly[924]: time="2026-08-23T16:58:23.347Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=11 command.system_time_ms=16 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T16:58:33.034" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:23.306" grpc.time_ms=41.18 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 388.501307] gitaly[924]: time="2026-08-23T16:58:23.378Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S duration_ms=344ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 388.508683] gitaly[924]: time="2026-08-23T16:58:23.379Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:23.029" grpc.time_ms=350.182 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 388.532239] gitaly[924]: time="2026-08-23T16:58:23.400Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S diskcache=9823c99f-25f0-4fdc-bfdd-fa0bd9193e8b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:22.017" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 388.552222] setup-gitlab-start[3803]: To http://gitlab/root/test-flake.git gitlab # [ 388.553802] setup-gitlab-start[3803]: * [new branch] master -> master gitlab # [ 388.555687] setup-gitlab-start[3803]: branch 'master' set up to track 'origin/master'. gitlab # [ 388.558359] gitlab-workhorse[820]: time="2026-08-23T16:58:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 388.561308] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:23 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1504 gitlab # [ 388.564628] systemd[1]: Finished setup-gitlab.service. gitlab # [ 388.565766] gitaly[924]: time="2026-08-23T16:58:23.400Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=393 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13580 command.oublock=32 command.real_time_ms=1369 command.spawn_token_fork_ms=2 command.system_time_ms=248 command.user_time_ms=145 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:22.017" grpc.time_ms=1382.684 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 388.585513] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 389.23 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 388.911538] sidekiq-cluster[3738]: {"severity":"INFO","time":"2026-08-23T16:58:23.734Z","message":"Starting cluster with 1 processes"} gitlab # [ 390.098851] nixbot[3896]: {"ts": "2026-08-23T16:58:24.983Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 390.140621] nixbot[3896]: {"ts": "2026-08-23T16:58:25.026Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 390.184162] nixbot[3896]: {"ts": "2026-08-23T16:58:25.069Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 390.192346] nixbot[3896]: {"ts": "2026-08-23T16:58:25.077Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 390.199136] nixbot[3896]: {"ts": "2026-08-23T16:58:25.084Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 390.209683] nixbot[3896]: {"ts": "2026-08-23T16:58:25.095Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 390.216604] nixbot[3896]: {"ts": "2026-08-23T16:58:25.102Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 390.221551] nixbot[3896]: {"ts": "2026-08-23T16:58:25.105Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 390.233016] nixbot[3896]: {"ts": "2026-08-23T16:58:25.118Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 390.237816] nixbot[3896]: {"ts": "2026-08-23T16:58:25.122Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 390.247164] nixbot[3896]: {"ts": "2026-08-23T16:58:25.132Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 390.260841] nixbot[3896]: {"ts": "2026-08-23T16:58:25.146Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 390.267199] nixbot[3896]: {"ts": "2026-08-23T16:58:25.152Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 390.272958] nixbot[3896]: {"ts": "2026-08-23T16:58:25.156Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 390.278749] nixbot[3896]: {"ts": "2026-08-23T16:58:25.163Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 390.284598] nixbot[3896]: {"ts": "2026-08-23T16:58:25.167Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 390.290211] nixbot[3896]: {"ts": "2026-08-23T16:58:25.170Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 390.296564] nixbot[3896]: {"ts": "2026-08-23T16:58:25.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 390.301464] nixbot[3896]: {"ts": "2026-08-23T16:58:25.182Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 390.306831] nixbot[3896]: {"ts": "2026-08-23T16:58:25.185Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 390.311785] nixbot[3896]: {"ts": "2026-08-23T16:58:25.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 390.316443] nixbot[3896]: {"ts": "2026-08-23T16:58:25.200Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 390.320935] nixbot[3896]: {"ts": "2026-08-23T16:58:25.204Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 390.325451] nixbot[3896]: {"ts": "2026-08-23T16:58:25.208Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 390.329758] nixbot[3896]: {"ts": "2026-08-23T16:58:25.211Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 390.943805] nixbot[3896]: INFO: Started server process [3896] gitlab # [ 390.946787] nixbot[3896]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 390.981596] nixbot[3896]: INFO: ::ffff:127.0.0.1:54600 - "GET /health HTTP/1.1" 200 OK gitlab # [ 390.991480] systemd[1]: Started nixbot CI service. gitlab # [ 390.996945] systemd[1]: Reached target Multi-User System. gitlab # [ 391.000074] systemd[1]: Startup finished in 720ms (kernel) + 4.324s (initrd) + 6min 25.954s (userspace) = 6min 30.999s. gitlab: (finished: waiting for unit nixbot.service, in 3.20 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 392.054688] nixbot[3896]: INFO: ::ffff:127.0.0.1:54784 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 392.242098] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1261 gitlab # [ 392.258908] nixbot[3896]: {"ts": "2026-08-23T16:58:27.138Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds) gitlab # [ 392.268473] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 142 gitlab # [ 392.313632] nixbot[3896]: {"ts": "2026-08-23T16:58:27.198Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 392.461073] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 130 gitlab # [ 392.467655] nixbot[3896]: {"ts": "2026-08-23T16:58:27.348Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 392.474984] nixbot[3896]: {"ts": "2026-08-23T16:58:27.351Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 392.630088] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 160 gitlab # [ 392.636995] nixbot[3896]: {"ts": "2026-08-23T16:58:27.516Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 392.823978] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 180 gitlab # [ 392.831690] nixbot[3896]: {"ts": "2026-08-23T16:58:27.710Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 392.960765] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 119 gitlab # [ 392.968888] nixbot[3896]: {"ts": "2026-08-23T16:58:27.847Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 393.051888] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:27 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 83 gitlab # [ 393.060335] nixbot[3896]: {"ts": "2026-08-23T16:58:27.938Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 393.156889] gitaly[924]: time="2026-08-23T16:58:28.040Z" level=info msg="finished unary call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYBQ9ZXTMS0N3HC1DMZAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-23T16:58:58.009" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:28.010" grpc.time_ms=29.674 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 393.202914] gitaly[924]: time="2026-08-23T16:58:28.061Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYBQ9ZXTMS0N3HC1DMZAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:58:58.059" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:28.060" grpc.time_ms=1.064 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 393.227603] gitaly[924]: time="2026-08-23T16:58:28.079Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYBQ9ZXTMS0N3HC1DMZAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-23T16:58:38.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:28.066" grpc.time_ms=12.413 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 393.247969] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 177 gitlab # [ 393.251294] nixbot[3896]: {"ts": "2026-08-23T16:58:28.124Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 393.355951] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 112 gitlab # [ 393.363794] nixbot[3896]: {"ts": "2026-08-23T16:58:28.242Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 393.372500] nixbot[3896]: {"ts": "2026-08-23T16:58:28.246Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds) gitlab # [ 393.442924] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 110 (finished: subtest: project discovered and webhook registered, in 1.38 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 393.490876] gitaly[924]: time="2026-08-23T16:58:28.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYC2N7PQHR16KC8FFNF0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=200 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.366" grpc.time_ms=9.806 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 393.526333] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 67 gitlab # [ 393.561849] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 34 gitlab # [ 393.648433] gitaly[924]: time="2026-08-23T16:58:28.534Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYC52K5G7PDV4KHZP7X07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.519" pid=924 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # Enumerating objects: 5, done. gitlab # [ 393.679994] gitaly[924]: time="2026-08-23T16:58:28.538Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYC52K5G7PDV4KHZP7X07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.519" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)[ 393.711454] gitlab-workhorse[820]: time="2026-08-23T16:58:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # Compressing objects: 100% (2/2)[ 393.714916] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 152 gitlab # Compressing objects: 100% (2/2), done. gitlab # [ 393.718157] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 99 gitlab # Writing objects: 33% (1/3)[ 393.721701] gitaly[924]: time="2026-08-23T16:58:28.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYC52K5G7PDV4KHZP7X07 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.519" grpc.time_ms=18.841 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # Writing objects: 66% (2/3)[ 393.740533] gitaly[924]: time="2026-08-23T16:58:28.547Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=14 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYC704Q093XJXY4TDQDEQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.526" grpc.time_ms=19.983 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 7.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 394.004560] gitaly[924]: time="2026-08-23T16:58:28.890Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYC9ZXDD2418NZAWPVAA2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.855" pid=924 remote_ip="2001:db8:1::1" request_sha=9b9f8b942615567e3d7ceb61230785554512b12e response_bytes=229 span.kind=server system=grpc gitlab # [ 394.017252] gitaly[924]: time="2026-08-23T16:58:28.890Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=7 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYC9ZXDD2418NZAWPVAA2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.855" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.033248] gitlab-workhorse[820]: time="2026-08-23T16:58:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=229 gitlab # [ 394.035464] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 229 "" "git/2.55.0" 349 gitlab # [ 394.038379] gitaly[924]: time="2026-08-23T16:58:28.891Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=7 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYC9ZXDD2418NZAWPVAA2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.855" grpc.time_ms=36.275 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.067094] gitaly[924]: time="2026-08-23T16:58:28.952Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T16:58:58.040" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T16:58:28.941" grpc.time_ms=10.548 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 394.128083] gitaly[924]: time="2026-08-23T16:58:29.012Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 duration_ms=194ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 394.181922] gitaly[924]: time="2026-08-23T16:58:29.066Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 duration_ms=52ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 394.187705] gitaly[924]: time="2026-08-23T16:58:29.066Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:28.818" grpc.time_ms=248.45 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 394.204776] gitaly[924]: time="2026-08-23T16:58:29.074Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=8 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCQKDR4FBE725XZA7T9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.061" grpc.time_ms=12.652 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.223166] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 99 gitlab # [ 394.236368] gitaly[924]: time="2026-08-23T16:58:29.121Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:29.119" grpc.time_ms=2.105 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 394.273129] gitaly[924]: time="2026-08-23T16:58:29.158Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:29.158" grpc.time_ms=0.47 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 394.323791] gitaly[924]: time="2026-08-23T16:58:29.209Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:29.208" grpc.time_ms=0.58 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 394.350618] gitaly[924]: time="2026-08-23T16:58:29.236Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCTS48GD3EVKM6RZGNQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.223" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 394.365093] gitaly[924]: time="2026-08-23T16:58:29.236Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCTS48GD3EVKM6RZGNQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.223" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.383114] gitlab-workhorse[820]: time="2026-08-23T16:58:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 394.385413] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 159 gitlab # [ 394.387637] gitaly[924]: time="2026-08-23T16:58:29.236Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCTS48GD3EVKM6RZGNQP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.223" grpc.time_ms=13.365 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.446405] gitaly[924]: time="2026-08-23T16:58:29.332Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 duration_ms=76ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 394.451181] gitaly[924]: time="2026-08-23T16:58:29.334Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:29.254" grpc.time_ms=77.813 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 394.469412] gitaly[924]: time="2026-08-23T16:58:29.345Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 diskcache=2ce505b9-3e20-4433-b239-c25eb34ee81f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.755" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # a8bdad1..6a6f623 master -> master gitlab # [ 394.491476] gitlab-workhorse[820]: time="2026-08-23T16:58:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 394.494678] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:29 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 699 gitlab # [ 394.497322] gitlab-workhorse[820]: time="2026-08-23T16:58:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=342 gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.06 seconds) gitlab # [ 394.499783] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.55.0" 103 gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 394.502281] gitaly[924]: time="2026-08-23T16:58:29.345Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=185 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=12570 command.oublock=32 command.real_time_ms=580 command.spawn_token_fork_ms=4 command.system_time_ms=97 command.user_time_ms=88 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:28.755" grpc.time_ms=589.801 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 394.521025] gitaly[924]: time="2026-08-23T16:58:29.345Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCZVVC66M6Z6AZVS9SSK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.325" pid=924 remote_ip="2001:db8:1::1" request_sha=6f5bfdbd1e220aba1fc1152031293379b5922512 response_bytes=342 span.kind=server system=grpc gitlab # [ 394.533521] gitaly[924]: time="2026-08-23T16:58:29.345Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCZVVC66M6Z6AZVS9SSK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.325" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.549790] gitaly[924]: time="2026-08-23T16:58:29.345Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCZVVC66M6Z6AZVS9SSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.325" grpc.time_ms=20.133 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.10 seconds) gitlab # [ 394.613933] gitaly[924]: time="2026-08-23T16:58:29.499Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYD4ZBNJXEHPGGSE92WVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.487" grpc.time_ms=12.282 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.637133] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 92 gitlab # [ 394.641133] nixbot[3896]: INFO: ::ffff:127.0.0.1:54800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 394.706588] gitaly[924]: time="2026-08-23T16:58:29.592Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYD7X3HSKQ0165C4WXKMN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.562" pid=924 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 394.731608] gitaly[924]: time="2026-08-23T16:58:29.592Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYD7X3HSKQ0165C4WXKMN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.562" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.758185] gitlab-workhorse[820]: time="2026-08-23T16:58:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 394.761218] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 91 gitlab # [ 394.764137] gitaly[924]: time="2026-08-23T16:58:29.594Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYD7X3HSKQ0165C4WXKMN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:29.562" grpc.time_ms=30.474 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 394.894570] gitaly[924]: time="2026-08-23T16:58:29.780Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:58:59.377" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:29.778" grpc.time_ms=1.128 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 394.969970] gitaly[924]: time="2026-08-23T16:58:29.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T16:58:59.433" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:29.834" grpc.time_ms=20.975 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.021385] gitaly[924]: time="2026-08-23T16:58:29.906Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:58:39.247" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:29.888" grpc.time_ms=18.224 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.060612] gitaly[924]: time="2026-08-23T16:58:29.946Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:58:39.287" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:29.927" grpc.time_ms=18.313 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.201103] gitaly[924]: time="2026-08-23T16:58:30.085Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T16:58:40.054" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:30.084" grpc.time_ms=0.666 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.239057] gitaly[924]: time="2026-08-23T16:58:30.124Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T16:58:40.075" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:30.106" grpc.time_ms=17.274 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.306197] gitaly[924]: time="2026-08-23T16:58:30.191Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:30.190" grpc.time_ms=0.941 pid=924 span.kind=server system=grpc gitlab # [ 395.358224] gitaly[924]: time="2026-08-23T16:58:30.243Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T16:58:30.243" grpc.time_ms=0.711 pid=924 span.kind=server system=grpc gitlab # [ 395.388615] gitaly[924]: time="2026-08-23T16:58:30.256Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J diskcache=4cce0658-c19b-4756-952c-67e5adad80c2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:58:40.098" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:30.129" pid=924 ref=refs/keep-around/a8bdad1461690e57748bf3993cfad1f37450b17f remote_ip="2001:db8:1::1" revision=a8bdad1461690e57748bf3993cfad1f37450b17f span.kind=server system=grpc username=root gitlab # [ 395.416402] gitaly[924]: time="2026-08-23T16:58:30.256Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5248 command.oublock=8 command.real_time_ms=118 command.spawn_token_fork_ms=2 command.system_time_ms=72 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T16:58:40.098" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T16:58:30.129" grpc.time_ms=127.002 pid=924 ref=refs/keep-around/a8bdad1461690e57748bf3993cfad1f37450b17f remote_ip="2001:db8:1::1" revision=a8bdad1461690e57748bf3993cfad1f37450b17f span.kind=server system=grpc username=root gitlab # [ 395.445720] gitaly[924]: time="2026-08-23T16:58:30.263Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:59:00.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:30.262" grpc.time_ms=0.593 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 395.659071] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 884 gitlab # [ 395.668644] nixbot[3896]: {"ts": "2026-08-23T16:58:30.545Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 395.678382] nixbot[3896]: {"ts": "2026-08-23T16:58:30.562Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a8bdad146169-0"} gitlab # [ 395.690600] nixbot[3896]: INFO: ::ffff:127.0.0.1:54810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab # [ 395.794693] systemd[1]: Started Nix Daemon. gitlab # [ 395.907530] nix-daemon[4121]: accepted connection from pid 4115, user nixbot gitlab # [ 396.050493] nix-daemon[4121]: accepted connection from pid 4128, user nixbot gitlab # [ 396.078253] nixbot[3896]: {"ts": "2026-08-23T16:58:30.963Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a8bdad146169-0", "argv0": "bwrap"} gitlab # [ 396.334045] nix-daemon[4121]: accepted connection from pid 4138, user nixbot gitlab # [ 396.437012] nix-daemon[4121]: accepted connection from pid 4148, user nixbot gitlab # [ 396.463325] nix-daemon[4121]: accepted connection from pid 4138, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 396.757362] nixbot[3896]: INFO: ::ffff:127.0.0.1:54818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 397.821576] nixbot[3896]: INFO: ::ffff:127.0.0.1:54822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 398.880495] nixbot[3896]: INFO: ::ffff:127.0.0.1:54832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 399.939231] nixbot[3896]: INFO: ::ffff:127.0.0.1:54842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 400.998928] nixbot[3896]: INFO: ::ffff:127.0.0.1:47362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 401.359907] gitaly[924]: time="2026-08-23T16:58:36.243Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYKN7C4WF2WZVHYSKE9JG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:59:06.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:36.241" grpc.time_ms=1.772 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 401.570728] gitaly[924]: time="2026-08-23T16:58:36.456Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYKN7C4WF2WZVHYSKE9JG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:58:46.087" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:36.438" grpc.time_ms=17.381 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 401.732990] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 545 gitlab # [ 401.741677] nixbot[3896]: {"ts": "2026-08-23T16:58:36.619Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 401.834042] gitaly[924]: time="2026-08-23T16:58:36.719Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYM6HJS0VXCC1RR4HC9PE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:59:06.514" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:36.715" grpc.time_ms=2.035 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 401.961553] gitaly[924]: time="2026-08-23T16:58:36.846Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYM6HJS0VXCC1RR4HC9PE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:58:46.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:36.818" grpc.time_ms=28.029 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 402.081835] nixbot[3896]: INFO: ::ffff:127.0.0.1:47378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.09 seconds) gitlab # [ 402.111933] nixbot[3896]: {"ts": "2026-08-23T16:58:36.996Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 402.116341] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 372 gitlab # [ 402.274967] gitaly[924]: time="2026-08-23T16:58:37.160Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYMKDCHMG2KXY2Y71ZPVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T16:59:07.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T16:58:37.158" grpc.time_ms=1.814 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.405115] gitaly[924]: time="2026-08-23T16:58:37.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=7 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYMKDCHMG2KXY2Y71ZPVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T16:58:47.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T16:58:37.263" grpc.time_ms=24.806 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.586179] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 433 gitlab # [ 402.594992] nixbot[3896]: {"ts": "2026-08-23T16:58:37.476Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 402.832472] nix-daemon[4121]: accepted connection from pid 4189, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 403.166658] gitaly[924]: time="2026-08-23T16:58:38.051Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYND9CMCR9SXC3F0CYNTS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:38.020" grpc.time_ms=30.138 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.11 seconds) gitlab # [ 403.203976] nixbot[3896]: INFO: ::ffff:127.0.0.1:47386 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 403.209812] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 222 gitlab # [ 403.352065] gitaly[924]: time="2026-08-23T16:58:38.237Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYNMCPM8N575JH4TP7NS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:38.215" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 403.372243] gitaly[924]: time="2026-08-23T16:58:38.237Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYNMCPM8N575JH4TP7NS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:38.215" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 403.395460] gitlab-workhorse[820]: time="2026-08-23T16:58:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 403.398419] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:16:58:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 146 gitlab # [ 403.401266] gitaly[924]: time="2026-08-23T16:58:38.238Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYNMCPM8N575JH4TP7NS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T16:58:38.215" grpc.time_ms=22.462 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 403.530222] nix-daemon[4121]: accepted connection from pid 4217, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 404.256854] nixbot[3896]: INFO: ::ffff:127.0.0.1:47396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 405.314765] nixbot[3896]: INFO: ::ffff:127.0.0.1:47408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 406.375281] nixbot[3896]: INFO: ::ffff:127.0.0.1:47410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 407.435885] nixbot[3896]: INFO: ::ffff:127.0.0.1:47412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 408.493399] nixbot[3896]: INFO: ::ffff:127.0.0.1:47416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 409.554562] nixbot[3896]: INFO: ::ffff:127.0.0.1:47432 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 410.619353] nixbot[3896]: INFO: ::ffff:127.0.0.1:47446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 411.679112] nixbot[3896]: INFO: ::ffff:127.0.0.1:37806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 412.736975] nixbot[3896]: INFO: ::ffff:127.0.0.1:37822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 413.797109] nixbot[3896]: INFO: ::ffff:127.0.0.1:37838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 414.855076] nixbot[3896]: INFO: ::ffff:127.0.0.1:37844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 415.917068] nixbot[3896]: INFO: ::ffff:127.0.0.1:37848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 416.977776] nixbot[3896]: INFO: ::ffff:127.0.0.1:37854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 418.038424] nixbot[3896]: INFO: ::ffff:127.0.0.1:37870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 419.102755] nixbot[3896]: INFO: ::ffff:127.0.0.1:37882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 420.150851] nixbot[3896]: INFO: ::ffff:127.0.0.1:37884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 421.214364] nixbot[3896]: INFO: ::ffff:127.0.0.1:35692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 422.265245] nixbot[3896]: INFO: ::ffff:127.0.0.1:35696 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 423.323022] nixbot[3896]: INFO: ::ffff:127.0.0.1:35700 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 424.383127] nixbot[3896]: INFO: ::ffff:127.0.0.1:35714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 425.448689] nixbot[3896]: INFO: ::ffff:127.0.0.1:35728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 426.530200] nixbot[3896]: INFO: ::ffff:127.0.0.1:35730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.08 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 427.595491] nixbot[3896]: INFO: ::ffff:127.0.0.1:35742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 428.647497] nixbot[3896]: INFO: ::ffff:127.0.0.1:35758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 429.709335] nixbot[3896]: INFO: ::ffff:127.0.0.1:35768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 430.774754] nixbot[3896]: INFO: ::ffff:127.0.0.1:35774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 431.849480] nixbot[3896]: INFO: ::ffff:127.0.0.1:32792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.08 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 432.921064] nixbot[3896]: INFO: ::ffff:127.0.0.1:32800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 433.982081] nixbot[3896]: INFO: ::ffff:127.0.0.1:32814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 435.045154] nixbot[3896]: INFO: ::ffff:127.0.0.1:32820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 436.097725] nixbot[3896]: INFO: ::ffff:127.0.0.1:32822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 437.206566] nixbot[3896]: INFO: ::ffff:127.0.0.1:32826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.12 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 438.271235] nixbot[3896]: INFO: ::ffff:127.0.0.1:32838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 439.329598] nixbot[3896]: INFO: ::ffff:127.0.0.1:32846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 440.387217] nixbot[3896]: INFO: ::ffff:127.0.0.1:32856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 440.478247] sidekiq-cluster[3908]: 2026-08-23T16:59:15.362Z pid=3908 tid=ycs INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3908, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430960640} gitlab # [ 440.796522] sidekiq-cluster[3908]: W, [2026-08-23T16:59:15.682090 #3908] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 440.858668] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T16:59:15.744Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 441.447429] nixbot[3896]: INFO: ::ffff:127.0.0.1:45816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 442.505315] nixbot[3896]: INFO: ::ffff:127.0.0.1:45818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 443.565254] nixbot[3896]: INFO: ::ffff:127.0.0.1:45824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 444.626211] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T16:59:19.510Z","message":"GitLab reliable fetch activated!"} gitlab # [ 444.626621] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T16:59:19.510Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 444.627717] nixbot[3896]: INFO: ::ffff:127.0.0.1:45836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 445.683463] nixbot[3896]: INFO: ::ffff:127.0.0.1:45846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 446.742736] nixbot[3896]: INFO: ::ffff:127.0.0.1:45856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 447.799032] nixbot[3896]: INFO: ::ffff:127.0.0.1:45858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 448.856444] nixbot[3896]: INFO: ::ffff:127.0.0.1:45864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 449.915262] nixbot[3896]: INFO: ::ffff:127.0.0.1:45878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 450.973152] nixbot[3896]: INFO: ::ffff:127.0.0.1:38366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 452.029228] nixbot[3896]: INFO: ::ffff:127.0.0.1:38372 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 453.085934] nixbot[3896]: INFO: ::ffff:127.0.0.1:38388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 454.140995] nixbot[3896]: INFO: ::ffff:127.0.0.1:38394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 455.198134] nixbot[3896]: INFO: ::ffff:127.0.0.1:38408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 456.255971] nixbot[3896]: INFO: ::ffff:127.0.0.1:38424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 457.308957] nixbot[3896]: INFO: ::ffff:127.0.0.1:38428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 458.362558] nixbot[3896]: INFO: ::ffff:127.0.0.1:38430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 459.417997] nixbot[3896]: INFO: ::ffff:127.0.0.1:38440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 460.473607] nixbot[3896]: INFO: ::ffff:127.0.0.1:38456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 461.530519] nixbot[3896]: INFO: ::ffff:127.0.0.1:46130 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 462.583350] nixbot[3896]: INFO: ::ffff:127.0.0.1:46134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 463.636176] nixbot[3896]: INFO: ::ffff:127.0.0.1:46136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 464.692278] nixbot[3896]: INFO: ::ffff:127.0.0.1:46148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 465.748698] nixbot[3896]: INFO: ::ffff:127.0.0.1:46160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 466.805479] nixbot[3896]: INFO: ::ffff:127.0.0.1:46166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 467.861011] nixbot[3896]: INFO: ::ffff:127.0.0.1:46168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 468.914022] nixbot[3896]: INFO: ::ffff:127.0.0.1:46170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 469.967841] nixbot[3896]: INFO: ::ffff:127.0.0.1:46180 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 471.024695] nixbot[3896]: INFO: ::ffff:127.0.0.1:54946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 472.151411] nixbot[3896]: INFO: ::ffff:127.0.0.1:54950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.13 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 473.210777] nixbot[3896]: INFO: ::ffff:127.0.0.1:54952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 474.264342] nixbot[3896]: INFO: ::ffff:127.0.0.1:54954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 475.322466] nixbot[3896]: INFO: ::ffff:127.0.0.1:54964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 476.373351] nixbot[3896]: INFO: ::ffff:127.0.0.1:54968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 477.429165] nixbot[3896]: INFO: ::ffff:127.0.0.1:54976 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 478.488583] nixbot[3896]: INFO: ::ffff:127.0.0.1:54988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 479.545768] nixbot[3896]: INFO: ::ffff:127.0.0.1:54990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 480.603578] nixbot[3896]: INFO: ::ffff:127.0.0.1:54992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 481.587115] postgres[4463]: [4463] ERROR: relation "table_without_models" does not exist gitlab # [ 481.587476] postgres[4463]: [4463] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 481.660473] nixbot[3896]: INFO: ::ffff:127.0.0.1:45582 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 482.719374] nixbot[3896]: INFO: ::ffff:127.0.0.1:45592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 483.775811] nixbot[3896]: INFO: ::ffff:127.0.0.1:45598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 484.831266] nixbot[3896]: INFO: ::ffff:127.0.0.1:45604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 485.612652] systemd[1]: Starting Logrotate Service... gitlab # [ 485.748321] systemd[1]: logrotate.service: Deactivated successfully. gitlab # [ 485.750774] systemd[1]: Finished Logrotate Service. gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 485.890036] nixbot[3896]: INFO: ::ffff:127.0.0.1:45616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 486.457704] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:01.342Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 486.460716] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:01.346Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 486.462774] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:01.346Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 486.464662] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:01.346Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 486.466632] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:01.349Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 486.945631] nixbot[3896]: INFO: ::ffff:127.0.0.1:45624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 488.022888] nixbot[3896]: INFO: ::ffff:127.0.0.1:45628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.08 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 489.116576] nixbot[3896]: INFO: ::ffff:127.0.0.1:45638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.09 seconds) gitlab # [ 489.158199] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.042Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"28caa4bba5051521c7e2c124","created_at":"2026-08-23T16:58:19.096Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:19.191Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-28caa4bba5051521c7e2c124: start","job_status":"start","queue_duration_s":104.851145,"scheduling_latency_s":104.851245} gitlab # [ 489.511452] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.396Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"28caa4bba5051521c7e2c124","created_at":"2026-08-23T16:58:19.096Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:19.191Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-28caa4bba5051521c7e2c124: done: 0.354082 sec","job_status":"done","queue_duration_s":104.851145,"scheduling_latency_s":104.851245,"redis_calls":23,"redis_duration_s":0.010042,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005268,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002886,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18626034,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.354082,"completed_at":"2026-08-23T17:00:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.10526,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 489.612967] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.399Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bf275f4a2347fa311fa16286","created_at":"2026-08-23T16:58:19.230Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:19.248Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bf275f4a2347fa311fa16286: start","job_status":"start","queue_duration_s":105.150776,"scheduling_latency_s":105.150807} gitlab # [ 489.684147] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.569Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bf275f4a2347fa311fa16286","created_at":"2026-08-23T16:58:19.230Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:19.248Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bf275f4a2347fa311fa16286: done: 0.170062 sec","job_status":"done","queue_duration_s":105.150776,"scheduling_latency_s":105.150807,"redis_calls":14,"redis_duration_s":0.004874,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000915,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002417,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001542,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13215716,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.170062,"completed_at":"2026-08-23T17:00:04.568Z","load_balancing_strategy":"primary","db_duration_s":0.036556,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 489.776137] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.571Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"c852cf3e1af8c620d8015726","created_at":"2026-08-23T16:58:20.144Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:20.156Z","job_size_bytes":5,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-c852cf3e1af8c620d8015726: start","job_status":"start","queue_duration_s":104.415427,"scheduling_latency_s":104.415457} gitlab # [ 489.911288] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.796Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"c852cf3e1af8c620d8015726","created_at":"2026-08-23T16:58:20.144Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:20.156Z","job_size_bytes":5,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-c852cf3e1af8c620d8015726: done: 0.224734 sec","job_status":"done","queue_duration_s":104.415427,"scheduling_latency_s":104.415457,"redis_calls":12,"redis_duration_s":0.004143,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000889,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002631,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041622,"duration_s":0.224734,"completed_at":"2026-08-23T17:00:04.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044115,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 490.011835] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:04.798Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"b0b3fb5ec9ada77752f11c1e","created_at":"2026-08-23T16:58:20.206Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:20.215Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-b0b3fb5ec9ada77752f11c1e: start","job_status":"start","queue_duration_s":104.582669,"scheduling_latency_s":104.582687} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 490.179917] nixbot[3896]: INFO: ::ffff:127.0.0.1:45646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 490.193555] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:05.077Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"b0b3fb5ec9ada77752f11c1e","created_at":"2026-08-23T16:58:20.206Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:20.215Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-b0b3fb5ec9ada77752f11c1e: done: 0.279507 sec","job_status":"done","queue_duration_s":104.582669,"scheduling_latency_s":104.582687,"redis_calls":11,"redis_duration_s":0.003356,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000733,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001957,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.237,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.237,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058548,"duration_s":0.279507,"completed_at":"2026-08-23T17:00:05.077Z","load_balancing_strategy":"primary","db_duration_s":0.1093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 490.281206] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:05.079Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"88786533af5239268fe80cdd","created_at":"2026-08-23T16:58:20.220Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:20.229Z","job_size_bytes":89,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-88786533af5239268fe80cdd: start","job_status":"start","queue_duration_s":104.85021,"scheduling_latency_s":104.850237} gitlab # [ 490.300812] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:05.127Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"88786533af5239268fe80cdd","created_at":"2026-08-23T16:58:20.220Z","trace_propagation_headers":{"sentry-trace":"586b971e95ac41c3b7bdc63f0da0a8f6-daff15ae67d144ca","baggage":"sentry-trace_id=586b971e95ac41c3b7bdc63f0da0a8f6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY0GKFGEA72BKXV9D62CM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:20.229Z","job_size_bytes":89,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-88786533af5239268fe80cdd: done: 0.047695 sec","job_status":"done","queue_duration_s":104.85021,"scheduling_latency_s":104.850237,"redis_calls":11,"redis_duration_s":0.00344,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001021,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052052,"duration_s":0.047695,"completed_at":"2026-08-23T17:00:05.127Z","load_balancing_strategy":"primary","db_duration_s":0.009015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 490.347054] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:05.129Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a8bdad1461690e57748bf3993cfad1f37450b17f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"37432564f67904dcb67bfc49","created_at":"2026-08-23T16:58:23.152Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-4cd00d1e3eb941be","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:23.217Z","job_size_bytes":185,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-37432564f67904dcb67bfc49: start","job_status":"start","queue_duration_s":101.911521,"scheduling_latency_s":101.91154} gitlab # [ 490.364417] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:05.148Z","message":"changes: \"0000000000000000000000000000000000000000 a8bdad1461690e57748bf3993cfad1f37450b17f refs/heads/master\\n\""} gitlab # [ 490.367127] gitaly[924]: time="2026-08-23T17:00:05.194Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:15.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:05.180" grpc.time_ms=14.502 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.380525] gitaly[924]: time="2026-08-23T17:00:05.219Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T17:00:15.030" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:05.201" grpc.time_ms=17.546 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.422314] gitaly[924]: time="2026-08-23T17:00:05.308Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T17:00:15.124" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:05.294" grpc.time_ms=13.599 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.502631] gitaly[924]: time="2026-08-23T17:00:05.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:05.387" grpc.time_ms=0.667 pid=924 span.kind=server system=grpc gitlab # [ 490.544100] gitaly[924]: time="2026-08-23T17:00:05.429Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:05.428" grpc.time_ms=0.826 pid=924 span.kind=server system=grpc gitlab # [ 490.563075] gitaly[924]: time="2026-08-23T17:00:05.446Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S diskcache=859489c4-43d4-4c5a-b81d-3fc3528ec6f3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T17:00:15.158" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:05.329" pid=924 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 490.579901] gitaly[924]: time="2026-08-23T17:00:05.447Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=128 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5029 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=1 command.system_time_ms=62 command.user_time_ms=66 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T17:00:15.158" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:05.329" grpc.time_ms=117.639 pid=924 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 490.599441] gitaly[924]: time="2026-08-23T17:00:05.482Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T17:00:15.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:05.482" grpc.time_ms=0.327 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.632001] gitaly[924]: time="2026-08-23T17:00:05.517Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T17:00:15.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:05.491" grpc.time_ms=26.011 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.814033] gitaly[924]: time="2026-08-23T17:00:05.699Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-23T17:00:35.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:05.686" grpc.time_ms=12.406 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.876412] gitaly[924]: time="2026-08-23T17:00:05.762Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T17:00:15.280" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:05.761" grpc.time_ms=0.616 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.907891] gitaly[924]: time="2026-08-23T17:00:05.778Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T17:00:15.286" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T17:00:05.766" grpc.time_ms=11.888 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.940795] gitaly[924]: time="2026-08-23T17:00:05.826Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:15.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:05.808" grpc.time_ms=17.897 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 490.969919] gitaly[924]: time="2026-08-23T17:00:05.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:15.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:05.837" grpc.time_ms=17.462 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 491.023238] gitaly[924]: time="2026-08-23T17:00:05.908Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T17:00:35.278" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:05.879" grpc.time_ms=29.51 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 491.245862] nixbot[3896]: INFO: ::ffff:127.0.0.1:42338 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab # [ 491.687604] gitaly[924]: time="2026-08-23T17:00:06.572Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T17:00:16.089" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:06.569" grpc.time_ms=2.016 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 491.763758] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:06.647Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a8bdad1461690e57748bf3993cfad1f37450b17f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"37432564f67904dcb67bfc49","created_at":"2026-08-23T16:58:23.152Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-4cd00d1e3eb941be","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:23.217Z","job_size_bytes":185,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-37432564f67904dcb67bfc49: done: 1.517676 sec","job_status":"done","queue_duration_s":101.911521,"scheduling_latency_s":101.91154,"gitaly_calls":13,"gitaly_duration_s":0.339886,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.06977,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.006993,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009927,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002711,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00564,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.028775,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015724,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.311,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.361,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.032073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071662,"exclusive_lock_hold_duration_s":0.03659056,"duration_s":1.517676,"completed_at":"2026-08-23T17:00:06.646Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.153972,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 491.873912] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:06.650Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a8bdad1461690e57748bf3993cfad1f37450b17f 6a6f623befe1a4f2066f9787883e510cda9dcb3b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0e44a040e7a3759ef5ea332f","created_at":"2026-08-23T16:58:29.305Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-845d61c045904e3d","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:29.309Z","job_size_bytes":185,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0e44a040e7a3759ef5ea332f: start","job_status":"start","queue_duration_s":97.341491,"scheduling_latency_s":97.34153} gitlab # [ 491.912563] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:06.674Z","message":"changes: \"a8bdad1461690e57748bf3993cfad1f37450b17f 6a6f623befe1a4f2066f9787883e510cda9dcb3b refs/heads/master\\n\""} gitlab # [ 491.916704] gitaly[924]: time="2026-08-23T17:00:06.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:16.228" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:06.708" grpc.time_ms=18.958 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 491.936386] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:06.764Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"127f3a09ae3fdf2e9827f15d","created_at":"2026-08-23T17:00:06.760Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"de1fb6e8c980077461209dbe","job_size_bytes":46,"pid":3908,"job_status":"deduplicated","message":"ProjectCacheWorker JID-127f3a09ae3fdf2e9827f15d: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 491.955382] gitaly[924]: time="2026-08-23T17:00:06.755Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T17:00:16.257" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:06.737" grpc.time_ms=16.881 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 491.970373] gitaly[924]: time="2026-08-23T17:00:06.808Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T17:00:16.001" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:06.791" grpc.time_ms=16.069 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 491.984459] gitaly[924]: time="2026-08-23T17:00:06.838Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-23T17:00:36.216" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:06.816" grpc.time_ms=21.28 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 492.000840] gitaly[924]: time="2026-08-23T17:00:06.869Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T17:00:16.057" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T17:00:06.858" grpc.time_ms=11.104 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 492.019675] gitaly[924]: time="2026-08-23T17:00:06.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:16.086" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:06.887" grpc.time_ms=17.641 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 492.311304] nixbot[3896]: INFO: ::ffff:127.0.0.1:42352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 492.372745] gitaly[924]: time="2026-08-23T17:00:07.258Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T17:00:17.084" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:07.254" grpc.time_ms=3.213 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 492.422081] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:07.306Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a8bdad1461690e57748bf3993cfad1f37450b17f 6a6f623befe1a4f2066f9787883e510cda9dcb3b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0e44a040e7a3759ef5ea332f","created_at":"2026-08-23T16:58:29.305Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-845d61c045904e3d","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T16:58:29.309Z","job_size_bytes":185,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0e44a040e7a3759ef5ea332f: done: 0.655785 sec","job_status":"done","queue_duration_s":97.341491,"scheduling_latency_s":97.34153,"gitaly_calls":7,"gitaly_duration_s":0.13695,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.041021999999999996,"redis_read_bytes":500,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.004513,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.002062,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006575,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.01274,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.015132,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.047,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.047,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.462783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00147838,"exclusive_lock_hold_duration_s":0.03650774,"duration_s":0.655785,"completed_at":"2026-08-23T17:00:07.306Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048782,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 492.507967] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:07.310Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"137df51e143071d933d9a229","created_at":"2026-08-23T16:58:30.271Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-e5922034f021478b","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:30.283Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-137df51e143071d933d9a229: start","job_status":"start","queue_duration_s":97.026558,"scheduling_latency_s":97.026604} gitlab # [ 492.597611] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:07.482Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"137df51e143071d933d9a229","created_at":"2026-08-23T16:58:30.271Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-e5922034f021478b","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:30.283Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-137df51e143071d933d9a229: done: 0.172419 sec","job_status":"done","queue_duration_s":97.026558,"scheduling_latency_s":97.026604,"redis_calls":16,"redis_duration_s":0.007148,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003563,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00081448,"duration_s":0.172419,"completed_at":"2026-08-23T17:00:07.482Z","load_balancing_strategy":"primary","db_duration_s":0.040893,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 492.676256] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:07.485Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b2440fdf6c3041611f808c94","created_at":"2026-08-23T16:58:30.287Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-e5922034f021478b","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:30.299Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b2440fdf6c3041611f808c94: start","job_status":"start","queue_duration_s":97.186215,"scheduling_latency_s":97.186246} gitlab # [ 492.798576] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:07.682Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b2440fdf6c3041611f808c94","created_at":"2026-08-23T16:58:30.287Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-e5922034f021478b","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:30.299Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b2440fdf6c3041611f808c94: done: 0.196696 sec","job_status":"done","queue_duration_s":97.186215,"scheduling_latency_s":97.186246,"redis_calls":21,"redis_duration_s":0.009053,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.004017,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002326,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010578,"duration_s":0.196696,"completed_at":"2026-08-23T17:00:07.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 492.905377] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:07.685Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9ad5c4a40f6c0738ebc055f9","created_at":"2026-08-23T16:58:30.503Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-e5922034f021478b","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:30.512Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ad5c4a40f6c0738ebc055f9: start","job_status":"start","queue_duration_s":97.172763,"scheduling_latency_s":97.172802} gitlab # [ 493.126477] gitaly[924]: time="2026-08-23T17:00:08.010Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:08.009" grpc.time_ms=1.11 pid=924 span.kind=server system=grpc gitlab # [ 493.185810] gitaly[924]: time="2026-08-23T17:00:08.071Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:08.070" grpc.time_ms=0.952 pid=924 span.kind=server system=grpc gitlab # [ 493.242090] gitaly[924]: time="2026-08-23T17:00:08.127Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:08.126" grpc.time_ms=0.895 pid=924 span.kind=server system=grpc gitlab # [ 493.273638] gitaly[924]: time="2026-08-23T17:00:08.141Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J diskcache=ec7e54cd-ace0-4060-b0f0-6e5705018692 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T17:00:37.346" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:07.946" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 493.299638] gitaly[924]: time="2026-08-23T17:00:08.142Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=218 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7504 command.oublock=0 command.real_time_ms=187 command.spawn_token_fork_ms=1 command.system_time_ms=109 command.user_time_ms=109 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T17:00:37.346" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:07.946" grpc.time_ms=195.109 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.08 seconds) gitlab # [ 493.392789] nixbot[3896]: INFO: ::ffff:127.0.0.1:42358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 493.497404] gitaly[924]: time="2026-08-23T17:00:08.382Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T17:00:38.080" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.380" grpc.time_ms=1.875 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 493.585639] gitaly[924]: time="2026-08-23T17:00:08.471Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYDCV8FFE6AS25BVCAS6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:38.168" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.469" grpc.time_ms=1.449 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 493.631253] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.515Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9ad5c4a40f6c0738ebc055f9","created_at":"2026-08-23T16:58:30.503Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-e5922034f021478b","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T16:58:30.512Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ad5c4a40f6c0738ebc055f9: done: 0.830162 sec","job_status":"done","queue_duration_s":97.172763,"scheduling_latency_s":97.172802,"gitaly_calls":3,"gitaly_duration_s":0.21158,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.050053,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002258,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002473,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.01673,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.009441,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.011294,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001216,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000838,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003545,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.106,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.04,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.045,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.477658,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7046043799999999,"duration_s":0.830162,"completed_at":"2026-08-23T17:00:08.515Z","load_balancing_strategy":"primary","db_duration_s":0.124676,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 493.739978] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.519Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"de1fb6e8c980077461209dbe","created_at":"2026-08-23T17:00:05.221Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:05.245Z","job_size_bytes":46,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-de1fb6e8c980077461209dbe: start","job_status":"start","queue_duration_s":3.274061,"scheduling_latency_s":3.274104} gitlab # [ 493.759940] gitaly[924]: time="2026-08-23T17:00:08.622Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-23T23:00:08.609" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:08.610" grpc.time_ms=10.771 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 493.773536] gitaly[924]: time="2026-08-23T17:00:08.659Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T17:00:38.339" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.640" grpc.time_ms=18.321 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 493.830170] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.714Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"de1fb6e8c980077461209dbe","created_at":"2026-08-23T17:00:05.221Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:05.245Z","job_size_bytes":46,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-de1fb6e8c980077461209dbe: done: 0.194758 sec","job_status":"done","queue_duration_s":3.274061,"scheduling_latency_s":3.274104,"gitaly_calls":2,"gitaly_duration_s":0.037396,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012871,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002306,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000981,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002771,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005259,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001554,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060118,"duration_s":0.194758,"completed_at":"2026-08-23T17:00:08.713Z","load_balancing_strategy":"primary","db_duration_s":0.017827,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 493.925314] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.716Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"83f6f9fffb68ea2348eddb86","created_at":"2026-08-23T17:00:05.276Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:05.286Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-83f6f9fffb68ea2348eddb86: start","job_status":"start","queue_duration_s":3.429837,"scheduling_latency_s":3.429866} gitlab # [ 493.948376] gitaly[924]: time="2026-08-23T17:00:08.794Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S diskcache=f8117505-0712-4cea-8af4-e6e1007f0688 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T23:00:08.753" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.753" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 493.961968] gitaly[924]: time="2026-08-23T17:00:08.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=47 command.spawn_token_fork_ms=4 command.system_time_ms=24 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T23:00:08.753" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.753" grpc.time_ms=40.718 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 493.983134] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.867Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"83f6f9fffb68ea2348eddb86","created_at":"2026-08-23T17:00:05.276Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:05.286Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-83f6f9fffb68ea2348eddb86: done: 0.151461 sec","job_status":"done","queue_duration_s":3.429837,"scheduling_latency_s":3.429866,"gitaly_calls":1,"gitaly_duration_s":0.044545,"redis_calls":15,"redis_duration_s":0.005474,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000965,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001681,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11078006,"duration_s":0.151461,"completed_at":"2026-08-23T17:00:08.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 494.034833] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.871Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8e1664e473bee36ab215d703","created_at":"2026-08-23T17:00:05.472Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:05.477Z","job_size_bytes":23,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8e1664e473bee36ab215d703: start","job_status":"start","queue_duration_s":3.39387,"scheduling_latency_s":3.393901} gitlab # [ 494.050681] gitaly[924]: time="2026-08-23T17:00:08.934Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T17:00:38.615" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.915" grpc.time_ms=18.34 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 494.065247] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.950Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8e1664e473bee36ab215d703","created_at":"2026-08-23T17:00:05.472Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:05.477Z","job_size_bytes":23,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8e1664e473bee36ab215d703: done: 0.079355 sec","job_status":"done","queue_duration_s":3.39387,"scheduling_latency_s":3.393901,"gitaly_calls":1,"gitaly_duration_s":0.02205,"redis_calls":16,"redis_duration_s":0.005681,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000521,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002357,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079355,"completed_at":"2026-08-23T17:00:08.950Z","load_balancing_strategy":"primary","db_duration_s":0.004894,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 494.110576] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:08.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2161165ccaa383a619bf4d85","created_at":"2026-08-23T17:00:06.324Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:531023feed95c1c62848ca5a249b434ef14870e9f0979b4c0a1af5ba498affec","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:06.334Z","job_size_bytes":467,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2161165ccaa383a619bf4d85: start","job_status":"start","queue_duration_s":2.618134,"scheduling_latency_s":2.618163} gitlab # [ 494.128464] gitaly[924]: time="2026-08-23T17:00:08.995Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:38.693" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:08.994" grpc.time_ms=0.995 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 494.141601] gitaly[924]: time="2026-08-23T17:00:09.015Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T17:00:18.198" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:08.998" grpc.time_ms=16.45 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 494.279038] gitaly[924]: time="2026-08-23T17:00:09.164Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T17:00:39.063" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:09.163" grpc.time_ms=1.249 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 494.317063] gitaly[924]: time="2026-08-23T17:00:09.176Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T17:00:39.072" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:09.172" grpc.time_ms=3.629 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 494.461368] nixbot[3896]: INFO: ::ffff:127.0.0.1:42368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.07 seconds) gitlab # [ 494.479075] gitaly[924]: time="2026-08-23T17:00:09.364Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:19.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:09.347" grpc.time_ms=16.607 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.263454] gitaly[924]: time="2026-08-23T17:00:10.147Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T17:00:40.018" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.119" grpc.time_ms=28.225 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.293719] gitaly[924]: time="2026-08-23T17:00:10.179Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01M0QRY5T8HC6QZKXW962SFQ7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T17:00:40.050" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.151" grpc.time_ms=27.67 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.363085] sidekiq-cluster[3908]: {"severity":"WARN","time":"2026-08-23T17:00:10.247Z","class":"CreatePipelineWorker","correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a8bdad1461690e57748bf3993cfad1f37450b17f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a8bdad1461690e57748bf3993cfad1f37450b17f","ref":"refs/heads/master"},"retry":0} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 495.416637] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:10.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"2161165ccaa383a619bf4d85","created_at":"2026-08-23T17:00:06.324Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:531023feed95c1c62848ca5a249b434ef14870e9f0979b4c0a1af5ba498affec","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:06.334Z","job_size_bytes":467,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-2161165ccaa383a619bf4d85: done: 1.311481 sec","job_status":"done","queue_duration_s":2.618134,"scheduling_latency_s":2.618163,"gitaly_calls":7,"gitaly_duration_s":0.12085,"redis_calls":51,"redis_duration_s":0.014830000000000001,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001332,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005989,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003651,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001762,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.108917,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006949,"duration_s":1.311481,"completed_at":"2026-08-23T17:00:10.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.084556,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 495.483027] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:10.267Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"da050951-aa9d-4aeb-9273-35832b801563\"}"],"class":"WebHookWorker","jid":"425cea5d73ae7ec4d8f8b3d5","created_at":"2026-08-23T17:00:06.528Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2cdac36575647fc160ed9595ea21a488c7f41ee632206c763c6bafa2228f3281","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:06.534Z","job_size_bytes":1751,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-425cea5d73ae7ec4d8f8b3d5: start","job_status":"start","queue_duration_s":3.732915,"scheduling_latency_s":3.732954} gitlab # [ 495.515191] nixbot[3896]: INFO: ::ffff:127.0.0.1:42378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) gitlab # [ 495.631564] nixbot[3896]: INFO: ::ffff:127.0.0.1:42388 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 495.675693] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:10.560Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"da050951-aa9d-4aeb-9273-35832b801563\"}"],"class":"WebHookWorker","jid":"425cea5d73ae7ec4d8f8b3d5","created_at":"2026-08-23T17:00:06.528Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-58b1a91e42c94c23","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2cdac36575647fc160ed9595ea21a488c7f41ee632206c763c6bafa2228f3281","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:06.534Z","job_size_bytes":1751,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-425cea5d73ae7ec4d8f8b3d5: done: 0.292389 sec","job_status":"done","queue_duration_s":3.732915,"scheduling_latency_s":3.732954,"redis_calls":19,"redis_duration_s":0.0072759999999999995,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001753,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000775,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003136,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001612,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09001238000001877,"cpu_s":0.176213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008156,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.292389,"completed_at":"2026-08-23T17:00:10.559Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 495.789447] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:10.563Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"614d5b370d9d5c3c60774af7","created_at":"2026-08-23T17:00:06.778Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"83f6f9fffb68ea2348eddb86","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:06.783Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-614d5b370d9d5c3c60774af7: start","job_status":"start","queue_duration_s":3.779945,"scheduling_latency_s":3.779988} gitlab # [ 495.817045] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:10.662Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"614d5b370d9d5c3c60774af7","created_at":"2026-08-23T17:00:06.778Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"83f6f9fffb68ea2348eddb86","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:06.783Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-614d5b370d9d5c3c60774af7: done: 0.098973 sec","job_status":"done","queue_duration_s":3.779945,"scheduling_latency_s":3.779988,"gitaly_calls":1,"gitaly_duration_s":0.019478,"redis_calls":12,"redis_duration_s":0.007093,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001062,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05055384,"duration_s":0.098973,"completed_at":"2026-08-23T17:00:10.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 495.868642] gitaly[924]: time="2026-08-23T17:00:10.625Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 diskcache=6bff0d93-45f8-46f4-9dc2-721025ed58eb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T23:00:10.610" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.611" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.878659] gitaly[924]: time="2026-08-23T17:00:10.626Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T23:00:10.610" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.611" grpc.time_ms=15.008 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.892456] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:10.666Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"543d26eceda55d9501b57d5c","created_at":"2026-08-23T17:00:07.015Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:526b9b55c7fa1b5b6cd16e483d5fb8467aee589c7277bcbad855d38197fac2df","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:07.178Z","job_size_bytes":467,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-543d26eceda55d9501b57d5c: start","job_status":"start","queue_duration_s":3.488649,"scheduling_latency_s":3.488684} gitlab # [ 495.910480] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 190 gitlab # [ 495.912626] gitaly[924]: time="2026-08-23T17:00:10.714Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:40.405" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.706" grpc.time_ms=7.517 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.925017] gitaly[924]: time="2026-08-23T17:00:10.735Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T17:00:20.007" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:10.717" grpc.time_ms=16.879 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.938164] gitaly[924]: time="2026-08-23T17:00:10.756Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1FY8SQG20M8BH983A4BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:10.738" grpc.time_ms=17.936 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 495.951657] gitaly[924]: time="2026-08-23T17:00:10.793Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T17:00:40.490" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.791" grpc.time_ms=1.832 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.964745] gitaly[924]: time="2026-08-23T17:00:10.807Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=170 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T17:00:40.497" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:10.798" grpc.time_ms=7.984 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.981732] gitaly[924]: time="2026-08-23T17:00:10.863Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:20.140" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:10.850" grpc.time_ms=12.583 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 495.995256] gitaly[924]: time="2026-08-23T17:00:10.874Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G485EXDF5G4N8M8Y3RQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:10.860" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 496.005926] gitlab-workhorse[820]: time="2026-08-23T17:00:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 496.007784] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 114 gitlab # [ 496.009861] gitaly[924]: time="2026-08-23T17:00:10.874Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G485EXDF5G4N8M8Y3RQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:10.860" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 496.023507] gitaly[924]: time="2026-08-23T17:00:10.875Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G485EXDF5G4N8M8Y3RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:10.860" grpc.time_ms=14.858 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 496.038574] nixbot[3896]: {"ts": "2026-08-23T17:00:10.919Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 496.261209] gitaly[924]: time="2026-08-23T17:00:11.146Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:41.144" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:11.145" grpc.time_ms=1.246 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 496.525349] gitaly[924]: time="2026-08-23T17:00:11.410Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=878 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T17:00:41.084" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:11.385" grpc.time_ms=24.879 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.05 seconds) gitlab # [ 496.556978] gitaly[924]: time="2026-08-23T17:00:11.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0QRYCD6BPDGVBCRE4CF3WP0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T17:00:41.115" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:11.416" grpc.time_ms=26.225 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 496.593357] gitaly[924]: time="2026-08-23T17:00:11.478Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:21.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:11.468" grpc.time_ms=9.628 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 496.622780] sidekiq-cluster[3908]: {"severity":"WARN","time":"2026-08-23T17:00:11.471Z","class":"CreatePipelineWorker","correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a8bdad1461690e57748bf3993cfad1f37450b17f","after":"6a6f623befe1a4f2066f9787883e510cda9dcb3b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"6a6f623befe1a4f2066f9787883e510cda9dcb3b","ref":"refs/heads/master"},"retry":0} gitlab # [ 496.634862] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"543d26eceda55d9501b57d5c","created_at":"2026-08-23T17:00:07.015Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:526b9b55c7fa1b5b6cd16e483d5fb8467aee589c7277bcbad855d38197fac2df","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:07.178Z","job_size_bytes":467,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-543d26eceda55d9501b57d5c: done: 0.819283 sec","job_status":"done","queue_duration_s":3.488649,"scheduling_latency_s":3.488684,"gitaly_calls":7,"gitaly_duration_s":0.126032,"redis_calls":33,"redis_duration_s":0.008644,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001215,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003866,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.66654,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.819283,"completed_at":"2026-08-23T17:00:11.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031197,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 496.694538] nixbot[3896]: INFO: ::ffff:127.0.0.1:42390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 496.696803] nixbot[3896]: INFO: ::ffff:127.0.0.1:42404 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 496.698236] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.491Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1164d8ec-4ede-4181-977d-76d444e552a4\"}"],"class":"WebHookWorker","jid":"80b6296b7a69e70015e71042","created_at":"2026-08-23T17:00:07.214Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a3d91d6df6df369fa5d1ebd720776c6f8b77f21627a69ce684bbf5f26c654488","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:07.220Z","job_size_bytes":1749,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-80b6296b7a69e70015e71042: start","job_status":"start","queue_duration_s":4.271001,"scheduling_latency_s":4.27105} gitlab # [ 496.718239] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.573Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1164d8ec-4ede-4181-977d-76d444e552a4\"}"],"class":"WebHookWorker","jid":"80b6296b7a69e70015e71042","created_at":"2026-08-23T17:00:07.214Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-dddef78ce44d4f66","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a3d91d6df6df369fa5d1ebd720776c6f8b77f21627a69ce684bbf5f26c654488","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:07.220Z","job_size_bytes":1749,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-80b6296b7a69e70015e71042: done: 0.082063 sec","job_status":"done","queue_duration_s":4.271001,"scheduling_latency_s":4.27105,"redis_calls":14,"redis_duration_s":0.009995,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.001115,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005516,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003364,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.012085900000045058,"cpu_s":0.049957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.082063,"completed_at":"2026-08-23T17:00:11.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 496.767600] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"258b3fa624d56db80331cb0f","created_at":"2026-08-23T17:00:07.918Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:07.928Z","job_size_bytes":23,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-258b3fa624d56db80331cb0f: start","job_status":"start","queue_duration_s":3.651025,"scheduling_latency_s":3.651061} gitlab # [ 496.784927] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 720 gitlab # [ 496.787451] nixbot[3896]: {"ts": "2026-08-23T17:00:11.660Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 496.806794] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.690Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"258b3fa624d56db80331cb0f","created_at":"2026-08-23T17:00:07.918Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:07.928Z","job_size_bytes":23,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-258b3fa624d56db80331cb0f: done: 0.11143 sec","job_status":"done","queue_duration_s":3.651025,"scheduling_latency_s":3.651061,"redis_calls":10,"redis_duration_s":0.007577,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078874,"duration_s":0.11143,"completed_at":"2026-08-23T17:00:11.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01997,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 496.852393] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.691Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bfaf2a3682f373ea8933c0c8","created_at":"2026-08-23T17:00:08.152Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.162Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bfaf2a3682f373ea8933c0c8: start","job_status":"start","queue_duration_s":3.52961,"scheduling_latency_s":3.52963} gitlab # [ 496.869409] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.745Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bfaf2a3682f373ea8933c0c8","created_at":"2026-08-23T17:00:08.152Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.162Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bfaf2a3682f373ea8933c0c8: done: 0.053729 sec","job_status":"done","queue_duration_s":3.52961,"scheduling_latency_s":3.52963,"redis_calls":10,"redis_duration_s":0.0067009999999999995,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001855,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090256,"duration_s":0.053729,"completed_at":"2026-08-23T17:00:11.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 496.914754] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.748Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4eb0ea671fd5bbe289dded3f","created_at":"2026-08-23T17:00:08.183Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.194Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4eb0ea671fd5bbe289dded3f: start","job_status":"start","queue_duration_s":3.553688,"scheduling_latency_s":3.553713} gitlab # [ 496.931842] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 98 gitlab # [ 496.934189] gitlab-workhorse[820]: time="2026-08-23T17:00:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 496.936158] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 81 gitlab # [ 496.938165] gitaly[924]: time="2026-08-23T17:00:11.700Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1GYH69QFMJ4JCBW00YXC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:11.686" grpc.time_ms=13.001 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 496.952114] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4eb0ea671fd5bbe289dded3f","created_at":"2026-08-23T17:00:08.183Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.194Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4eb0ea671fd5bbe289dded3f: done: 0.048151 sec","job_status":"done","queue_duration_s":3.553688,"scheduling_latency_s":3.553713,"redis_calls":10,"redis_duration_s":0.005066,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000681,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069794,"duration_s":0.048151,"completed_at":"2026-08-23T17:00:11.796Z","load_balancing_strategy":"primary","db_duration_s":0.006407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 496.997912] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:11.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"97bc58bc1e393fa4eb90a6d2","created_at":"2026-08-23T17:00:08.219Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.228Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-97bc58bc1e393fa4eb90a6d2: start","job_status":"start","queue_duration_s":3.57455,"scheduling_latency_s":3.574579} gitlab # [ 497.013962] gitaly[924]: time="2026-08-23T17:00:11.759Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H0HKKNAFAJV66AASSD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:41.758" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:11.758" grpc.time_ms=0.81 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 497.028039] gitaly[924]: time="2026-08-23T17:00:11.783Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H1PG0R967XBWABB429T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:11.770" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 497.039032] nix-daemon[4121]: accepted connection from pid 4714, user nixbot gitlab # [ 497.040086] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 257 gitlab # [ 497.046698] gitaly[924]: time="2026-08-23T17:00:11.783Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H1PG0R967XBWABB429T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:11.770" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.060784] nixbot[3896]: {"ts": "2026-08-23T17:00:11.924Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 497.063505] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 106 gitlab # [ 497.065758] gitaly[924]: time="2026-08-23T17:00:11.783Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H1PG0R967XBWABB429T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:11.770" grpc.time_ms=12.908 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.080893] gitaly[924]: time="2026-08-23T17:00:11.817Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=9 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1H0HKKNAFAJV66AASSD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:21.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:11.797" grpc.time_ms=20.319 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 497.094936] gitaly[924]: time="2026-08-23T17:00:11.932Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=16 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1H5K79QXMRNVW6ZQ5YYE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:11.903" grpc.time_ms=29.054 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.116458] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.001Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"97bc58bc1e393fa4eb90a6d2","created_at":"2026-08-23T17:00:08.219Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.228Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-97bc58bc1e393fa4eb90a6d2: done: 0.19892 sec","job_status":"done","queue_duration_s":3.57455,"scheduling_latency_s":3.574579,"redis_calls":13,"redis_duration_s":0.002071,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000352,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025864,"duration_s":0.19892,"completed_at":"2026-08-23T17:00:12.001Z","load_balancing_strategy":"primary","db_duration_s":0.005371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.162958] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.003Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e648c3771373580a8463b3ae","created_at":"2026-08-23T17:00:08.232Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.247Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e648c3771373580a8463b3ae: start","job_status":"start","queue_duration_s":3.756832,"scheduling_latency_s":3.756852} gitlab # [ 497.180403] gitlab-workhorse[820]: time="2026-08-23T17:00:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 497.182315] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 93 gitlab # [ 497.184303] gitaly[924]: time="2026-08-23T17:00:12.030Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H91R188M7WGDDDMPN2Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.018" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 497.194645] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.064Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e648c3771373580a8463b3ae","created_at":"2026-08-23T17:00:08.232Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.247Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e648c3771373580a8463b3ae: done: 0.060241 sec","job_status":"done","queue_duration_s":3.756832,"scheduling_latency_s":3.756852,"redis_calls":10,"redis_duration_s":0.020126,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00521782,"duration_s":0.060241,"completed_at":"2026-08-23T17:00:12.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.240867] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.066Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c4016b679b7fb94e7153b51f","created_at":"2026-08-23T17:00:08.248Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.261Z","job_size_bytes":19,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c4016b679b7fb94e7153b51f: start","job_status":"start","queue_duration_s":3.80544,"scheduling_latency_s":3.805459} gitlab # [ 497.257292] gitaly[924]: time="2026-08-23T17:00:12.030Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H91R188M7WGDDDMPN2Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.018" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.270987] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c4016b679b7fb94e7153b51f","created_at":"2026-08-23T17:00:08.248Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.261Z","job_size_bytes":19,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c4016b679b7fb94e7153b51f: done: 0.048981 sec","job_status":"done","queue_duration_s":3.80544,"scheduling_latency_s":3.805459,"redis_calls":11,"redis_duration_s":0.004543999999999999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002923,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035034,"duration_s":0.048981,"completed_at":"2026-08-23T17:00:12.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.316388] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.117Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"af793e798e3e78cc0f60acdf","created_at":"2026-08-23T17:00:08.267Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.276Z","job_size_bytes":66,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-af793e798e3e78cc0f60acdf: start","job_status":"start","queue_duration_s":3.840674,"scheduling_latency_s":3.84069} gitlab # [ 497.333853] gitaly[924]: time="2026-08-23T17:00:12.035Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H91R188M7WGDDDMPN2Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.018" grpc.time_ms=12.078 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.348920] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 87 gitlab # [ 497.351037] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.159Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"af793e798e3e78cc0f60acdf","created_at":"2026-08-23T17:00:08.267Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.276Z","job_size_bytes":66,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-af793e798e3e78cc0f60acdf: done: 0.042547 sec","job_status":"done","queue_duration_s":3.840674,"scheduling_latency_s":3.84069,"redis_calls":10,"redis_duration_s":0.001402,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024658,"duration_s":0.042547,"completed_at":"2026-08-23T17:00:12.159Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.398689] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5f4601e1b400c47f8ab236d9","created_at":"2026-08-23T17:00:08.278Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.289Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5f4601e1b400c47f8ab236d9: start","job_status":"start","queue_duration_s":3.871815,"scheduling_latency_s":3.871834} gitlab # [ 497.415040] gitaly[924]: time="2026-08-23T17:00:12.166Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1HDF3ZKYARQRG04P4VMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.155" grpc.time_ms=10.283 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.428347] gitaly[924]: time="2026-08-23T17:00:12.242Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HG8F2XQP16J8FMXX20E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.223" pid=924 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc gitlab # [ 497.439559] gitlab-workhorse[820]: time="2026-08-23T17:00:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=221 gitlab # [ 497.441538] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 74 gitlab # [ 497.443422] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5f4601e1b400c47f8ab236d9","created_at":"2026-08-23T17:00:08.278Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.289Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5f4601e1b400c47f8ab236d9: done: 0.057974 sec","job_status":"done","queue_duration_s":3.871815,"scheduling_latency_s":3.871834,"redis_calls":10,"redis_duration_s":0.001699,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023264,"duration_s":0.057974,"completed_at":"2026-08-23T17:00:12.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.489342] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.220Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"78c7fbea04ea33b4efe2aae8","created_at":"2026-08-23T17:00:08.306Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.317Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-78c7fbea04ea33b4efe2aae8: start","job_status":"start","queue_duration_s":3.903476,"scheduling_latency_s":3.903493} gitlab # [ 497.506986] gitaly[924]: time="2026-08-23T17:00:12.242Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HG8F2XQP16J8FMXX20E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.223" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 497.521461] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 450 gitlab # [ 497.524119] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.276Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"78c7fbea04ea33b4efe2aae8","created_at":"2026-08-23T17:00:08.306Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.317Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-78c7fbea04ea33b4efe2aae8: done: 0.055799 sec","job_status":"done","queue_duration_s":3.903476,"scheduling_latency_s":3.903493,"redis_calls":10,"redis_duration_s":0.006897,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002698,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000362,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025082,"duration_s":0.055799,"completed_at":"2026-08-23T17:00:12.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b' gitlab # [ 497.569367] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7120c7ac49b683d0d0f2da8b","created_at":"2026-08-23T17:00:08.318Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.326Z","job_size_bytes":6,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7120c7ac49b683d0d0f2da8b: start","job_status":"start","queue_duration_s":3.951844,"scheduling_latency_s":3.951862} gitlab # [ 497.584553] nixbot[3896]: {"ts": "2026-08-23T17:00:12.375Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a8bdad1461690e57748bf3993cfad1f37450b17f \"HTTP/1.1 201 Created\""} gitlab # [ 497.587519] gitaly[924]: time="2026-08-23T17:00:12.242Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HG8F2XQP16J8FMXX20E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T17:00:12.223" grpc.time_ms=19.725 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b', in 0.06 seconds) (finished: subtest: push delivers the webhook, in 104.18 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses gitlab # [ 497.601455] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.305Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7120c7ac49b683d0d0f2da8b","created_at":"2026-08-23T17:00:08.318Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.326Z","job_size_bytes":6,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7120c7ac49b683d0d0f2da8b: done: 0.026792 sec","job_status":"done","queue_duration_s":3.951844,"scheduling_latency_s":3.951862,"redis_calls":10,"redis_duration_s":0.001668,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034398,"duration_s":0.026792,"completed_at":"2026-08-23T17:00:12.305Z","load_balancing_strategy":"primary","db_duration_s":0.002376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.647107] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7a8b92f09dc24ec9dbf55048","created_at":"2026-08-23T17:00:08.327Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.336Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7a8b92f09dc24ec9dbf55048: start","job_status":"start","queue_duration_s":3.970882,"scheduling_latency_s":3.970901} gitlab # [ 497.662526] gitaly[924]: time="2026-08-23T17:00:12.251Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1H8V8AMED9VDDM5KY9DF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:42.250" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:12.250" grpc.time_ms=0.773 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 497.675391] nixbot[3896]: INFO: ::ffff:127.0.0.1:42412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 200 OK gitlab # [ 497.677422] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.383Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7a8b92f09dc24ec9dbf55048","created_at":"2026-08-23T17:00:08.327Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.336Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7a8b92f09dc24ec9dbf55048: done: 0.076542 sec","job_status":"done","queue_duration_s":3.970882,"scheduling_latency_s":3.970901,"redis_calls":10,"redis_duration_s":0.017709,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037638,"duration_s":0.076542,"completed_at":"2026-08-23T17:00:12.383Z","load_balancing_strategy":"primary","db_duration_s":0.021025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.720357] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.386Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9003d6f8e23af7ed62fa7324","created_at":"2026-08-23T17:00:08.348Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.358Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9003d6f8e23af7ed62fa7324: start","job_status":"start","queue_duration_s":4.027819,"scheduling_latency_s":4.027839} gitlab # [ 497.736641] gitaly[924]: time="2026-08-23T17:00:12.305Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1H8V8AMED9VDDM5KY9DF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:22.025" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:12.296" grpc.time_ms=8.389 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses, in 0.15 seconds) gitlab # [ 497.750264] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.464Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9003d6f8e23af7ed62fa7324","created_at":"2026-08-23T17:00:08.348Z","trace_propagation_headers":{"sentry-trace":"e5c359338c4043fe9140f94496c6eb62-2ce7af1a015e48ee","baggage":"sentry-trace_id=e5c359338c4043fe9140f94496c6eb62,sentry-release=Unknown"},"correlation_id":"01M0QRYDCV8FFE6AS25BVCAS6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.358Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9003d6f8e23af7ed62fa7324: done: 0.078164 sec","job_status":"done","queue_duration_s":4.027819,"scheduling_latency_s":4.027839,"redis_calls":14,"redis_duration_s":0.003907,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031996,"duration_s":0.078164,"completed_at":"2026-08-23T17:00:12.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.794492] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"cbf788a4efcd7174bb5becc9","created_at":"2026-08-23T17:00:08.677Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-e8f93fe98a594110","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.688Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-cbf788a4efcd7174bb5becc9: start","job_status":"start","queue_duration_s":3.777643,"scheduling_latency_s":3.777661} gitlab # [ 497.810687] gitaly[924]: time="2026-08-23T17:00:12.351Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:42.148" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:12.349" grpc.time_ms=2.608 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 497.824151] nixbot[3896]: {"ts": "2026-08-23T17:00:12.649Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b \"HTTP/1.1 201 Created\""} gitlab # [ 497.826944] nixbot[3896]: {"ts": "2026-08-23T17:00:12.666Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-6a6f623befe1-4"} gitlab # [ 497.829403] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.531Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"cbf788a4efcd7174bb5becc9","created_at":"2026-08-23T17:00:08.677Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-e8f93fe98a594110","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:08.688Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-cbf788a4efcd7174bb5becc9: done: 0.065694 sec","job_status":"done","queue_duration_s":3.777643,"scheduling_latency_s":3.777661,"redis_calls":19,"redis_duration_s":0.005699,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000735,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00057,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002919,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001475,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00925144,"duration_s":0.065694,"completed_at":"2026-08-23T17:00:12.531Z","load_balancing_strategy":"primary","db_duration_s":0.006377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.876660] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.534Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","425cea5d73ae7ec4d8f8b3d5"],"class":"WebHooks::LogExecutionWorker","jid":"ff946c4ea72319d6998f0c2b","created_at":"2026-08-23T17:00:10.523Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-36278a075fae409f","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2a9eabbd21545b000e94df0592fa920a8ae83c729d176f0ee9b41b1ac2ab19e9","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:10.537Z","job_size_bytes":2593,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ff946c4ea72319d6998f0c2b: start","job_status":"start","queue_duration_s":1.997221,"scheduling_latency_s":1.997245} gitlab # [ 497.893801] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 361 gitlab # [ 497.896342] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 112 gitlab # [ 497.899043] gitaly[924]: time="2026-08-23T17:00:12.374Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T17:00:42.164" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:12.365" grpc.time_ms=8.949 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 497.913514] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.591Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","425cea5d73ae7ec4d8f8b3d5"],"class":"WebHooks::LogExecutionWorker","jid":"ff946c4ea72319d6998f0c2b","created_at":"2026-08-23T17:00:10.523Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-36278a075fae409f","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2a9eabbd21545b000e94df0592fa920a8ae83c729d176f0ee9b41b1ac2ab19e9","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:10.537Z","job_size_bytes":2593,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-ff946c4ea72319d6998f0c2b: done: 0.057162 sec","job_status":"done","queue_duration_s":1.997221,"scheduling_latency_s":1.997245,"redis_calls":10,"redis_duration_s":0.003238,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026338,"duration_s":0.057162,"completed_at":"2026-08-23T17:00:12.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 497.958851] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.593Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","80b6296b7a69e70015e71042"],"class":"WebHooks::LogExecutionWorker","jid":"a12871fffc297fd50e09a263","created_at":"2026-08-23T17:00:11.553Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-b868afaa3d68429a","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a089b0160b0b380aad68bf99b11eca512fb77175244e27c768ec984a824812c2","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:11.558Z","job_size_bytes":2592,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a12871fffc297fd50e09a263: start","job_status":"start","queue_duration_s":1.035252,"scheduling_latency_s":1.035275} gitlab # [ 497.975507] nix-daemon[4121]: accepted connection from pid 4784, user nixbot gitlab # [ 497.976451] nix-daemon[4121]: accepted connection from pid 4802, user nixbot gitlab # [ 497.977402] gitaly[924]: time="2026-08-23T17:00:12.395Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:22.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:12.383" grpc.time_ms=11.803 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 497.991172] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.621Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","80b6296b7a69e70015e71042"],"class":"WebHooks::LogExecutionWorker","jid":"a12871fffc297fd50e09a263","created_at":"2026-08-23T17:00:11.553Z","trace_propagation_headers":{"sentry-trace":"f8d2a9f95e144a8ca86ca43584ce1cac-b868afaa3d68429a","baggage":"sentry-trace_id=f8d2a9f95e144a8ca86ca43584ce1cac,sentry-release=Unknown"},"correlation_id":"01M0QRYCD6BPDGVBCRE4CF3WP0","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a089b0160b0b380aad68bf99b11eca512fb77175244e27c768ec984a824812c2","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:11.558Z","job_size_bytes":2592,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a12871fffc297fd50e09a263: done: 0.028415 sec","job_status":"done","queue_duration_s":1.035252,"scheduling_latency_s":1.035275,"redis_calls":7,"redis_duration_s":0.002219,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028415,"completed_at":"2026-08-23T17:00:12.621Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 498.034865] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.624Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"df987caa128e95fcf5fdc8e1","created_at":"2026-08-23T17:00:11.599Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-57825f78d7fe4de4","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:11.608Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-df987caa128e95fcf5fdc8e1: start","job_status":"start","queue_duration_s":1.015995,"scheduling_latency_s":1.016018} gitlab # [ 498.050825] nixbot[3896]: {"ts": "2026-08-23T17:00:12.834Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-6a6f623befe1-4", "argv0": "bwrap"} gitlab # [ 498.053345] gitaly[924]: time="2026-08-23T17:00:12.423Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T17:00:22.162" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:12.423" grpc.time_ms=0.257 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.064501] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.935Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"df987caa128e95fcf5fdc8e1","created_at":"2026-08-23T17:00:11.599Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-57825f78d7fe4de4","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:11.608Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3908,"job_status":"rescheduled","message":"PipelineProcessWorker JID-df987caa128e95fcf5fdc8e1: rescheduled"} gitlab # [ 498.080660] gitaly[924]: time="2026-08-23T17:00:12.437Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T17:00:22.168" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:12.429" grpc.time_ms=8.385 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.094013] gitaly[924]: time="2026-08-23T17:00:12.473Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:12.472" grpc.time_ms=0.841 pid=924 span.kind=server system=grpc gitlab # [ 498.103787] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.951Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"df987caa128e95fcf5fdc8e1","created_at":"2026-08-23T17:00:11.599Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-57825f78d7fe4de4","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:11.608Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-df987caa128e95fcf5fdc8e1: done: 0.32757 sec","job_status":"done","queue_duration_s":1.015995,"scheduling_latency_s":1.016018,"gitaly_calls":3,"gitaly_duration_s":0.104079,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015917,"redis_read_bytes":150,"redis_write_bytes":18017,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000496,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000931,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003188,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12316,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005514,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000247,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002885,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00216,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.164044,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.26808952,"duration_s":0.32757,"completed_at":"2026-08-23T17:00:12.951Z","load_balancing_strategy":"primary","db_duration_s":0.053898,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 498.156688] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:12.954Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"eddb675c207bcc470a840c13","created_at":"2026-08-23T17:00:12.511Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-affd2177f1e7418c","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.517Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-eddb675c207bcc470a840c13: start","job_status":"start","queue_duration_s":0.437297,"scheduling_latency_s":0.437342} gitlab # [ 498.173759] gitaly[924]: time="2026-08-23T17:00:12.507Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:12.506" grpc.time_ms=0.353 pid=924 span.kind=server system=grpc gitlab # [ 498.183591] gitaly[924]: time="2026-08-23T17:00:12.518Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C diskcache=4da9e524-1e45-4db4-a412-0ec7cf51d474 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T17:00:22.179" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:12.440" pid=924 ref=refs/keep-around/6a6f623befe1a4f2066f9787883e510cda9dcb3b remote_ip="2001:db8:1::1" revision=6a6f623befe1a4f2066f9787883e510cda9dcb3b span.kind=server system=grpc username=root gitlab # [ 498.195667] gitaly[924]: time="2026-08-23T17:00:12.518Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5058 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=3 command.system_time_ms=31 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T17:00:22.179" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T17:00:12.440" grpc.time_ms=78.418 pid=924 ref=refs/keep-around/6a6f623befe1a4f2066f9787883e510cda9dcb3b remote_ip="2001:db8:1::1" revision=6a6f623befe1a4f2066f9787883e510cda9dcb3b span.kind=server system=grpc username=root gitlab # [ 498.211692] gitaly[924]: time="2026-08-23T17:00:12.521Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:42.321" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:12.521" grpc.time_ms=0.297 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.225530] gitaly[924]: time="2026-08-23T17:00:12.615Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HVY082WKNMNSKRSWN3Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:42.614" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:12.615" grpc.time_ms=0.58 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.239452] gitaly[924]: time="2026-08-23T17:00:12.751Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:12.751" grpc.time_ms=0.358 pid=924 span.kind=server system=grpc gitlab # [ 498.249763] gitaly[924]: time="2026-08-23T17:00:12.777Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:12.776" grpc.time_ms=0.444 pid=924 span.kind=server system=grpc gitlab # [ 498.260040] gitaly[924]: time="2026-08-23T17:00:12.798Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T17:00:12.798" grpc.time_ms=0.477 pid=924 span.kind=server system=grpc gitlab # [ 498.269633] gitaly[924]: time="2026-08-23T17:00:12.805Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF diskcache=db6580c6-cd1c-468b-93fe-e39b5e4f6b1b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T17:00:42.410" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:12.710" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.280313] gitaly[924]: time="2026-08-23T17:00:12.805Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=89 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7149 command.oublock=0 command.real_time_ms=90 command.spawn_token_fork_ms=3 command.system_time_ms=57 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T17:00:42.410" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:12.710" grpc.time_ms=94.947 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.293394] nix-daemon[4121]: accepted connection from pid 4829, user nixbot gitlab # [ 498.294391] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.163Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"eddb675c207bcc470a840c13","created_at":"2026-08-23T17:00:12.511Z","trace_propagation_headers":{"sentry-trace":"3caccf1ec5e24eb19e7b00ae1e3bb3dd-affd2177f1e7418c","baggage":"sentry-trace_id=3caccf1ec5e24eb19e7b00ae1e3bb3dd,sentry-release=Unknown"},"correlation_id":"01M0QRY5T8HC6QZKXW962SFQ7S","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.517Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-eddb675c207bcc470a840c13: done: 0.208358 sec","job_status":"done","queue_duration_s":0.437297,"scheduling_latency_s":0.437342,"redis_calls":11,"redis_duration_s":0.007839,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000709,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005547,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00303444,"duration_s":0.208358,"completed_at":"2026-08-23T17:00:13.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 498.340818] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.166Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"04d9653106c707b894105733","created_at":"2026-08-23T17:00:12.523Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-45c3cc14ecab41ac","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.532Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-04d9653106c707b894105733: start","job_status":"start","queue_duration_s":0.633746,"scheduling_latency_s":0.633782} gitlab # [ 498.357763] gitaly[924]: time="2026-08-23T17:00:12.875Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T17:00:42.574" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:12.874" grpc.time_ms=0.918 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.371061] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.226Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"04d9653106c707b894105733","created_at":"2026-08-23T17:00:12.523Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-45c3cc14ecab41ac","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.532Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-04d9653106c707b894105733: done: 0.059676 sec","job_status":"done","queue_duration_s":0.633746,"scheduling_latency_s":0.633782,"redis_calls":7,"redis_duration_s":0.002124,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059676,"completed_at":"2026-08-23T17:00:13.226Z","load_balancing_strategy":"primary","db_duration_s":0.008593,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 498.415251] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.228Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"271b14d66ce296b321d4f432","created_at":"2026-08-23T17:00:12.534Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-45c3cc14ecab41ac","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.538Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-271b14d66ce296b321d4f432: start","job_status":"start","queue_duration_s":0.690062,"scheduling_latency_s":0.690092} gitlab # [ 498.433391] gitaly[924]: time="2026-08-23T17:00:12.918Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1G9RCYKQB3PT6FRQ4KPF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:42.616" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:12.917" grpc.time_ms=0.847 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.446468] nix-daemon[4121]: accepted connection from pid 4839, user nixbot gitlab # [ 498.447461] nix-daemon[4121]: accepted connection from pid 4829, user nixbot gitlab # [ 498.481130] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.366Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"271b14d66ce296b321d4f432","created_at":"2026-08-23T17:00:12.534Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-45c3cc14ecab41ac","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.538Z","job_size_bytes":65,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-271b14d66ce296b321d4f432: done: 0.137967 sec","job_status":"done","queue_duration_s":0.690062,"scheduling_latency_s":0.690092,"redis_calls":10,"redis_duration_s":0.0035069999999999997,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.137967,"completed_at":"2026-08-23T17:00:13.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 498.529106] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.368Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b26658d78c2bb0f5550c96d2","created_at":"2026-08-23T17:00:12.625Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-45c3cc14ecab41ac","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.629Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b26658d78c2bb0f5550c96d2: start","job_status":"start","queue_duration_s":0.738993,"scheduling_latency_s":0.739017} gitlab # [ 498.607760] gitaly[924]: time="2026-08-23T17:00:13.492Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T17:00:43.190" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:13.490" grpc.time_ms=1.553 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 498.669957] gitaly[924]: time="2026-08-23T17:00:13.555Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1HKX5FYWNMEC6MBZ533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:43.253" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:13.554" grpc.time_ms=1.281 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses gitlab # [ 498.709681] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.573Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b26658d78c2bb0f5550c96d2","created_at":"2026-08-23T17:00:12.625Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-45c3cc14ecab41ac","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.629Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b26658d78c2bb0f5550c96d2: done: 0.20488 sec","job_status":"done","queue_duration_s":0.738993,"scheduling_latency_s":0.739017,"gitaly_calls":2,"gitaly_duration_s":0.010423,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011144000000000001,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002013,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001672,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000462,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002304,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000433,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000693,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.151774,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15622404,"duration_s":0.20488,"completed_at":"2026-08-23T17:00:13.573Z","load_balancing_strategy":"primary","db_duration_s":0.045698,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 498.793335] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e7906425d181ddabeffe8939","created_at":"2026-08-23T17:00:12.702Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.704Z","job_size_bytes":23,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e7906425d181ddabeffe8939: start","job_status":"start","queue_duration_s":0.870961,"scheduling_latency_s":0.870987} gitlab # [ 498.813044] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e7906425d181ddabeffe8939","created_at":"2026-08-23T17:00:12.702Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.704Z","job_size_bytes":23,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e7906425d181ddabeffe8939: done: 0.061331 sec","job_status":"done","queue_duration_s":0.870961,"scheduling_latency_s":0.870987,"redis_calls":7,"redis_duration_s":0.002496,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061331,"completed_at":"2026-08-23T17:00:13.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014118,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 498.864832] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.639Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"32bdd70af7afff85c5789ec1","created_at":"2026-08-23T17:00:12.810Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.812Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-32bdd70af7afff85c5789ec1: start","job_status":"start","queue_duration_s":0.827182,"scheduling_latency_s":0.827209} gitlab # [ 498.881647] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.679Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"32bdd70af7afff85c5789ec1","created_at":"2026-08-23T17:00:12.810Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.812Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-32bdd70af7afff85c5789ec1: done: 0.039756 sec","job_status":"done","queue_duration_s":0.827182,"scheduling_latency_s":0.827209,"redis_calls":7,"redis_duration_s":0.0021089999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001552,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039756,"completed_at":"2026-08-23T17:00:13.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 498.927614] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c94389ff4ff471cf599f7eb7","created_at":"2026-08-23T17:00:12.820Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.822Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c94389ff4ff471cf599f7eb7: start","job_status":"start","queue_duration_s":0.859357,"scheduling_latency_s":0.85938} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses, in 0.23 seconds) gitlab # [ 498.973438] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.727Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c94389ff4ff471cf599f7eb7","created_at":"2026-08-23T17:00:12.820Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.822Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c94389ff4ff471cf599f7eb7: done: 0.046042 sec","job_status":"done","queue_duration_s":0.859357,"scheduling_latency_s":0.85938,"redis_calls":7,"redis_duration_s":0.002045,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000587,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046042,"completed_at":"2026-08-23T17:00:13.727Z","load_balancing_strategy":"primary","db_duration_s":0.009716,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.042506] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"05aabc56e9dd36bba9965f90","created_at":"2026-08-23T17:00:12.842Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.844Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-05aabc56e9dd36bba9965f90: start","job_status":"start","queue_duration_s":0.884473,"scheduling_latency_s":0.884493} gitlab # [ 499.062834] gitaly[924]: time="2026-08-23T17:00:13.844Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1K1SHATSCKSR68MW3ZVY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:43.843" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:13.843" grpc.time_ms=0.691 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 499.077788] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 128 gitlab # [ 499.080654] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"05aabc56e9dd36bba9965f90","created_at":"2026-08-23T17:00:12.842Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.844Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-05aabc56e9dd36bba9965f90: done: 0.040202 sec","job_status":"done","queue_duration_s":0.884473,"scheduling_latency_s":0.884493,"redis_calls":10,"redis_duration_s":0.001612,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00037,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040202,"completed_at":"2026-08-23T17:00:13.769Z","load_balancing_strategy":"primary","db_duration_s":0.009257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.125058] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.771Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4c3d95b13e60d70d295b3afb","created_at":"2026-08-23T17:00:12.845Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.847Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4c3d95b13e60d70d295b3afb: start","job_status":"start","queue_duration_s":0.923483,"scheduling_latency_s":0.9235} gitlab # [ 499.141603] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.804Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4c3d95b13e60d70d295b3afb","created_at":"2026-08-23T17:00:12.845Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.847Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4c3d95b13e60d70d295b3afb: done: 0.033206 sec","job_status":"done","queue_duration_s":0.923483,"scheduling_latency_s":0.9235,"redis_calls":7,"redis_duration_s":0.001237,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033206,"completed_at":"2026-08-23T17:00:13.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.183992] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.806Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f49be3824bb98e8e26120b5d","created_at":"2026-08-23T17:00:12.848Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.851Z","job_size_bytes":19,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f49be3824bb98e8e26120b5d: start","job_status":"start","queue_duration_s":0.955084,"scheduling_latency_s":0.9551} gitlab # [ 499.200001] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f49be3824bb98e8e26120b5d","created_at":"2026-08-23T17:00:12.848Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.851Z","job_size_bytes":19,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f49be3824bb98e8e26120b5d: done: 0.028959 sec","job_status":"done","queue_duration_s":0.955084,"scheduling_latency_s":0.9551,"redis_calls":8,"redis_duration_s":0.001176,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028959,"completed_at":"2026-08-23T17:00:13.835Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.241912] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.836Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7ce114464d09fa9cb45068a1","created_at":"2026-08-23T17:00:12.852Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.855Z","job_size_bytes":66,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7ce114464d09fa9cb45068a1: start","job_status":"start","queue_duration_s":0.981159,"scheduling_latency_s":0.981176} gitlab # [ 499.259077] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.867Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7ce114464d09fa9cb45068a1","created_at":"2026-08-23T17:00:12.852Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.855Z","job_size_bytes":66,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7ce114464d09fa9cb45068a1: done: 0.031037 sec","job_status":"done","queue_duration_s":0.981159,"scheduling_latency_s":0.981176,"redis_calls":7,"redis_duration_s":0.0038120000000000003,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002402,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031037,"completed_at":"2026-08-23T17:00:13.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.302367] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.869Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5009afe628ba3cd7c364069c","created_at":"2026-08-23T17:00:12.855Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.858Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5009afe628ba3cd7c364069c: start","job_status":"start","queue_duration_s":1.011406,"scheduling_latency_s":1.011423} gitlab # [ 499.318575] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.898Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5009afe628ba3cd7c364069c","created_at":"2026-08-23T17:00:12.855Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.858Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5009afe628ba3cd7c364069c: done: 0.029383 sec","job_status":"done","queue_duration_s":1.011406,"scheduling_latency_s":1.011423,"redis_calls":7,"redis_duration_s":0.001771,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029383,"completed_at":"2026-08-23T17:00:13.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.361578] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.901Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"139d04b459bd5db1f978bc76","created_at":"2026-08-23T17:00:12.858Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.860Z","job_size_bytes":6,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-139d04b459bd5db1f978bc76: start","job_status":"start","queue_duration_s":1.040778,"scheduling_latency_s":1.040796} gitlab # [ 499.377393] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.918Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"139d04b459bd5db1f978bc76","created_at":"2026-08-23T17:00:12.858Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.860Z","job_size_bytes":6,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-139d04b459bd5db1f978bc76: done: 0.017001 sec","job_status":"done","queue_duration_s":1.040778,"scheduling_latency_s":1.040796,"redis_calls":7,"redis_duration_s":0.001817,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017001,"completed_at":"2026-08-23T17:00:13.918Z","load_balancing_strategy":"primary","db_duration_s":0.000594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.418977] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1518e469ea9d8242bad6f410","created_at":"2026-08-23T17:00:12.860Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.862Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1518e469ea9d8242bad6f410: start","job_status":"start","queue_duration_s":1.056839,"scheduling_latency_s":1.056854} gitlab # [ 499.434755] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1518e469ea9d8242bad6f410","created_at":"2026-08-23T17:00:12.860Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.862Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1518e469ea9d8242bad6f410: done: 0.028109 sec","job_status":"done","queue_duration_s":1.056839,"scheduling_latency_s":1.056854,"redis_calls":7,"redis_duration_s":0.0018539999999999997,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028109,"completed_at":"2026-08-23T17:00:13.947Z","load_balancing_strategy":"primary","db_duration_s":0.005404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 499.476370] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.949Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9f8faf8591806306732a6d69","created_at":"2026-08-23T17:00:12.936Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.940Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9f8faf8591806306732a6d69: start","job_status":"start","queue_duration_s":1.009245,"scheduling_latency_s":1.009262} gitlab # [ 499.491613] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.981Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"9f8faf8591806306732a6d69","created_at":"2026-08-23T17:00:12.936Z","trace_propagation_headers":{"sentry-trace":"67a566c8481b4e9198d2ea84ce7bcc2d-3249e7f4e8fc4190","baggage":"sentry-trace_id=67a566c8481b4e9198d2ea84ce7bcc2d,sentry-release=Unknown"},"correlation_id":"01M0QS1G9RCYKQB3PT6FRQ4KPF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:12.940Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9f8faf8591806306732a6d69: done: 0.031903 sec","job_status":"done","queue_duration_s":1.009245,"scheduling_latency_s":1.009262,"redis_calls":8,"redis_duration_s":0.002113,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031903,"completed_at":"2026-08-23T17:00:13.981Z","load_balancing_strategy":"primary","db_duration_s":0.006453,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 499.533355] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:13.983Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c1d8a30227467a899cdfeafb","created_at":"2026-08-23T17:00:13.465Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-5f53eff23cf247c1","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:13.468Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c1d8a30227467a899cdfeafb: start","job_status":"start","queue_duration_s":0.514747,"scheduling_latency_s":0.514764} gitlab # [ 499.550552] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:14.062Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c1d8a30227467a899cdfeafb","created_at":"2026-08-23T17:00:13.465Z","trace_propagation_headers":{"sentry-trace":"5ebbf100476b4e28a8864732953c3f63-5f53eff23cf247c1","baggage":"sentry-trace_id=5ebbf100476b4e28a8864732953c3f63,sentry-release=Unknown"},"correlation_id":"01M0QS1HKX5FYWNMEC6MBZ533C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:13.468Z","job_size_bytes":3,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c1d8a30227467a899cdfeafb: done: 0.079099 sec","job_status":"done","queue_duration_s":0.514747,"scheduling_latency_s":0.514764,"redis_calls":7,"redis_duration_s":0.005837,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001972,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079099,"completed_at":"2026-08-23T17:00:14.062Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses gitlab # [ 500.200184] gitaly[924]: time="2026-08-23T17:00:15.084Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1M7ZD5JX72NMMX7KEK58 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:45.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:15.083" grpc.time_ms=1.203 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses, in 0.27 seconds) gitlab # [ 500.273893] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 182 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses gitlab # [ 501.439355] gitaly[924]: time="2026-08-23T17:00:16.323Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1NES29B7S6TZM78JA24Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:46.121" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:16.322" grpc.time_ms=1.258 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses, in 0.22 seconds) gitlab # [ 501.498054] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 164 gitlab # [ 501.954770] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:16.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"19515d84ce4e4df3ea5ac42e","created_at":"2026-08-23T17:00:16.806Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7797afc063da4e7757807951375d9f40","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:16.831Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-19515d84ce4e4df3ea5ac42e: start","job_status":"start","queue_duration_s":0.006574,"scheduling_latency_s":0.006635} gitlab # [ 502.096564] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:16.980Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"19515d84ce4e4df3ea5ac42e","created_at":"2026-08-23T17:00:16.806Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7797afc063da4e7757807951375d9f40","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:16.831Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-19515d84ce4e4df3ea5ac42e: done: 0.141847 sec","job_status":"done","queue_duration_s":0.006574,"scheduling_latency_s":0.006635,"redis_calls":11,"redis_duration_s":0.028343999999999998,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.00566,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003662,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.141847,"completed_at":"2026-08-23T17:00:16.980Z","load_balancing_strategy":"primary","db_duration_s":0.001993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 502.192000] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:16.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1816a7408cef66a07979f1aa","created_at":"2026-08-23T17:00:16.861Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfec8625971fc847370ca2d3134b54e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:16.879Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1816a7408cef66a07979f1aa: start","job_status":"start","queue_duration_s":0.105123,"scheduling_latency_s":0.105174} gitlab # [ 502.212602] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1816a7408cef66a07979f1aa","created_at":"2026-08-23T17:00:16.861Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfec8625971fc847370ca2d3134b54e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:16.879Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1816a7408cef66a07979f1aa: done: 0.106203 sec","job_status":"done","queue_duration_s":0.105123,"scheduling_latency_s":0.105174,"redis_calls":11,"redis_duration_s":0.022439,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007168,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003916,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106203,"completed_at":"2026-08-23T17:00:17.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 502.266547] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"ba305a429efecc363e36a07d","created_at":"2026-08-23T17:00:16.888Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3042cd15a97dd0f5050dd9762ed0ac10","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:16.923Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-ba305a429efecc363e36a07d: start","job_status":"start","queue_duration_s":0.182459,"scheduling_latency_s":0.182548} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses gitlab # [ 502.414188] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"ba305a429efecc363e36a07d","created_at":"2026-08-23T17:00:16.888Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3042cd15a97dd0f5050dd9762ed0ac10","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:16.923Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-ba305a429efecc363e36a07d: done: 0.193014 sec","job_status":"done","queue_duration_s":0.182459,"scheduling_latency_s":0.182548,"redis_calls":10,"redis_duration_s":0.024914000000000002,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003093,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00301118,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00900858},"duration_s":0.193014,"completed_at":"2026-08-23T17:00:17.298Z","load_balancing_strategy":"primary","db_duration_s":0.055854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 502.509023] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"6c86f6913fcf9e74f27009ee","created_at":"2026-08-23T17:00:16.946Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14f1d7363c805a9b87f678ea239394f6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.025Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-6c86f6913fcf9e74f27009ee: start","job_status":"start","queue_duration_s":0.286341,"scheduling_latency_s":0.286388} gitlab # [ 502.600385] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"6c86f6913fcf9e74f27009ee","created_at":"2026-08-23T17:00:16.946Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14f1d7363c805a9b87f678ea239394f6","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.025Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-6c86f6913fcf9e74f27009ee: done: 0.170187 sec","job_status":"done","queue_duration_s":0.286341,"scheduling_latency_s":0.286388,"redis_calls":20,"redis_duration_s":0.066362,"redis_read_bytes":22,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.029698,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.01325,"redis_queues_read_bytes":5,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.016691,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006723,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0034605,"duration_s":0.170187,"completed_at":"2026-08-23T17:00:17.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses, in 0.20 seconds) gitlab # [ 502.691974] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"e4d29ce51dc5dac81b7dd2cc","created_at":"2026-08-23T17:00:17.055Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea65c25c1ee426025cc879818361166b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.085Z","job_size_bytes":101,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-e4d29ce51dc5dac81b7dd2cc: start","job_status":"start","queue_duration_s":0.403887,"scheduling_latency_s":0.403935} gitlab # [ 502.710123] gitaly[924]: time="2026-08-23T17:00:17.549Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1PNXVSBRKXM2B7W2YJZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:47.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:17.548" grpc.time_ms=1.334 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 502.725608] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 110 gitlab # [ 502.794270] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"e4d29ce51dc5dac81b7dd2cc","created_at":"2026-08-23T17:00:17.055Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea65c25c1ee426025cc879818361166b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.085Z","job_size_bytes":101,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-e4d29ce51dc5dac81b7dd2cc: done: 0.189451 sec","job_status":"done","queue_duration_s":0.403887,"scheduling_latency_s":0.403935,"redis_calls":10,"redis_duration_s":0.011657,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002937,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00184936,"duration_s":0.189451,"completed_at":"2026-08-23T17:00:17.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 502.884702] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"256a550310a80780c167fb65","created_at":"2026-08-23T17:00:17.108Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37b8882d55dbb005f031edc6acb9cc18","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.124Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-256a550310a80780c167fb65: start","job_status":"start","queue_duration_s":0.563668,"scheduling_latency_s":0.563722} gitlab # [ 502.928765] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"256a550310a80780c167fb65","created_at":"2026-08-23T17:00:17.108Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37b8882d55dbb005f031edc6acb9cc18","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.124Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-256a550310a80780c167fb65: done: 0.119261 sec","job_status":"done","queue_duration_s":0.563668,"scheduling_latency_s":0.563722,"redis_calls":10,"redis_duration_s":0.025876,"redis_read_bytes":9,"redis_write_bytes":1055,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.011261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003624,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0019452,"duration_s":0.119261,"completed_at":"2026-08-23T17:00:17.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 503.017600] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"0bfb2bc15ba0ed8ab0af107e","created_at":"2026-08-23T17:00:17.136Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"668b4d3111a1b0ceef8554b3c7220b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.163Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-0bfb2bc15ba0ed8ab0af107e: start","job_status":"start","queue_duration_s":0.666368,"scheduling_latency_s":0.666419} gitlab # [ 503.071605] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"0bfb2bc15ba0ed8ab0af107e","created_at":"2026-08-23T17:00:17.136Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"668b4d3111a1b0ceef8554b3c7220b9f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.163Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-0bfb2bc15ba0ed8ab0af107e: done: 0.126455 sec","job_status":"done","queue_duration_s":0.666368,"scheduling_latency_s":0.666419,"redis_calls":12,"redis_duration_s":0.021948,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007179,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009386,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00479316,"exclusive_lock_hold_duration_s":0.033055760000000003,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.126455,"completed_at":"2026-08-23T17:00:17.955Z","load_balancing_strategy":"primary","db_duration_s":0.037736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 503.142065] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:17.970Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"7203994452438dbd85c278cd","created_at":"2026-08-23T17:00:17.187Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8cb551fe32a89d8478270af1534a21a","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.213Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-7203994452438dbd85c278cd: start","job_status":"start","queue_duration_s":0.757634,"scheduling_latency_s":0.757685} gitlab # [ 503.156788] gitaly[924]: time="2026-08-23T17:00:17.968Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1Q27FGNZ4REY56SCCZWF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:47.766" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:17.967" grpc.time_ms=1.315 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 503.169616] gitaly[924]: time="2026-08-23T17:00:18.039Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=7 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1Q27FGNZ4REY56SCCZWF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:28.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:18.028" grpc.time_ms=10.538 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 503.242281] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"7203994452438dbd85c278cd","created_at":"2026-08-23T17:00:17.187Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8cb551fe32a89d8478270af1534a21a","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.213Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-7203994452438dbd85c278cd: done: 0.156293 sec","job_status":"done","queue_duration_s":0.757634,"scheduling_latency_s":0.757685,"redis_calls":10,"redis_duration_s":0.016316,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002634,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0016532,"duration_s":0.156293,"completed_at":"2026-08-23T17:00:18.126Z","load_balancing_strategy":"primary","db_duration_s":0.021061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 503.319520] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"387a6e24f75fd4af9e2aff32","created_at":"2026-08-23T17:00:17.223Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"580c44b73742e1e3093d825997106e0e","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.235Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-387a6e24f75fd4af9e2aff32: start","job_status":"start","queue_duration_s":0.896962,"scheduling_latency_s":0.896997} gitlab # [ 503.336054] nixbot[3896]: {"ts": "2026-08-23T17:00:18.156Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b \"HTTP/1.1 201 Created\""} gitlab # [ 503.338993] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 289 gitlab # [ 503.344986] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"387a6e24f75fd4af9e2aff32","created_at":"2026-08-23T17:00:17.223Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"580c44b73742e1e3093d825997106e0e","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.235Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-387a6e24f75fd4af9e2aff32: done: 0.098263 sec","job_status":"done","queue_duration_s":0.896962,"scheduling_latency_s":0.896997,"redis_calls":10,"redis_duration_s":0.023084,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003807,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00568462,"duration_s":0.098263,"completed_at":"2026-08-23T17:00:18.230Z","load_balancing_strategy":"primary","db_duration_s":0.041771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 503.389200] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1826ade6ddd2f5c7e6a583a8","created_at":"2026-08-23T17:00:17.260Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"879d00bc604d397bcbbb78e075f663e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.280Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1826ade6ddd2f5c7e6a583a8: start","job_status":"start","queue_duration_s":0.962146,"scheduling_latency_s":0.962193} gitlab # [ 503.404446] gitaly[924]: time="2026-08-23T17:00:18.269Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1QBPNNC3FDFKPQ4BGAFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:48.267" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:18.268" grpc.time_ms=0.929 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 503.443127] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1826ade6ddd2f5c7e6a583a8","created_at":"2026-08-23T17:00:17.260Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"879d00bc604d397bcbbb78e075f663e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.280Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1826ade6ddd2f5c7e6a583a8: done: 0.085054 sec","job_status":"done","queue_duration_s":0.962146,"scheduling_latency_s":0.962193,"redis_calls":9,"redis_duration_s":0.005696,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000953,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00162,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085054,"completed_at":"2026-08-23T17:00:18.327Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 503.494042] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f619694d0c849143baa521e4","created_at":"2026-08-23T17:00:17.300Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af8abbd1941b21e51102b1ff89ec640d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.318Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f619694d0c849143baa521e4: start","job_status":"start","queue_duration_s":1.012342,"scheduling_latency_s":1.012388} gitlab # [ 503.508973] gitaly[924]: time="2026-08-23T17:00:18.345Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1QBPNNC3FDFKPQ4BGAFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:28.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:18.327" grpc.time_ms=17.423 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 503.532353] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"f619694d0c849143baa521e4","created_at":"2026-08-23T17:00:17.300Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af8abbd1941b21e51102b1ff89ec640d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.318Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-f619694d0c849143baa521e4: done: 0.08652 sec","job_status":"done","queue_duration_s":1.012342,"scheduling_latency_s":1.012388,"redis_calls":9,"redis_duration_s":0.011439999999999999,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.08652,"completed_at":"2026-08-23T17:00:18.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 503.576944] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"f2ed0e95519e029abc59c135","created_at":"2026-08-23T17:00:17.328Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8babd89b77bfcfc9972d8447388603b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.351Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-f2ed0e95519e029abc59c135: start","job_status":"start","queue_duration_s":1.073428,"scheduling_latency_s":1.073459} gitlab # [ 503.592127] nixbot[3896]: {"ts": "2026-08-23T17:00:18.443Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b \"HTTP/1.1 201 Created\""} gitlab # [ 503.595031] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 275 gitlab # [ 503.641933] gitaly[924]: time="2026-08-23T17:00:18.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1QMQFMTW3NMPCPZBJHEX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:48.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:18.526" grpc.time_ms=0.882 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses gitlab # [ 503.701218] gitaly[924]: time="2026-08-23T17:00:18.586Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0QS1QMQFMTW3NMPCPZBJHEX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T17:00:28.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T17:00:18.572" grpc.time_ms=14 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 503.760203] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/23:17:00:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 188 gitlab # [ 503.768638] nixbot[3896]: {"ts": "2026-08-23T17:00:18.645Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6a6f623befe1a4f2066f9787883e510cda9dcb3b \"HTTP/1.1 201 Created\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6a6f623befe1a4f2066f9787883e510cda9dcb3b/statuses, in 0.16 seconds) (finished: subtest: eval and build post commit statuses, in 6.23 seconds) (finished: run the VM test script, in 574.39 seconds) gitlab # [ 503.806943] sidekiq-cluster[3908]: {"severity":"INFO","time":"2026-08-23T17:00:18.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"f2ed0e95519e029abc59c135","created_at":"2026-08-23T17:00:17.328Z","trace_propagation_headers":{"sentry-trace":"c646cb72acf84a35a734744b539af1ab-803ca3b47f2a43b8","baggage":"sentry-trace_id=c646cb72acf84a35a734744b539af1ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8babd89b77bfcfc9972d8447388603b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-23T17:00:17.351Z","job_size_bytes":2,"pid":3908,"sidekiq_tid":"m90s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-f2ed0e95519e029abc59c135: done: 0.267638 sec","job_status":"done","queue_duration_s":1.073428,"scheduling_latency_s":1.073459,"redis_calls":24,"redis_duration_s":0.007718,"redis_read_bytes":25,"redis_write_bytes":5977,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002631,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.000287,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3810,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.003623,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.191171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026662,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.267638,"completed_at":"2026-08-23T17:00:18.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} test script finished in 574.45s cleanup gitlab # [ 503.903406] gitaly[924]: time="2026-08-23T17:00:18.720Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0QS1QVJG7V9N435KQC1DRNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T17:00:48.618" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T17:00:18.719" grpc.time_ms=0.683 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root kill QemuMachine (pid 46) gitlab # [ 503.926503] nix-daemon[4121]: accepted connection from pid 4900, user nixbot gitlab # [ 503.927856] gitlab-workhorse[820]: gitlaqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.47 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-23T16:58:27.491Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-23T17:00:12.275820Z', 'started_at': None, 'finished_at': None}] [{'id': 5, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T17:00:12.618Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T17:00:12.618Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T17:00:12.618Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T17:00:12.618Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T17:00:12.618Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-23T17:00:12.618Z', 'started_at': None, 'finished_at': '2026-08-23T17:00:18.109Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '6a6f623befe1a4f2066f9787883e510cda9dcb3b', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-23T17:00:18.398Z', 'started_at': None, 'finished_at': '2026-08-23T17:00:18.613Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]